-- Logs begin at Sun 2022-10-16 00:10:46 UTC, end at Sun 2022-10-16 01:18:59 UTC. -- Oct 16 00:42:05.612305 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 16 00:42:05.620245 dv-cinder-master-3-smb devstack@keystone.service[81451]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 16 00:42:05 2022] *** Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: nodename: dv-cinder-master-3-smb Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: machine: x86_64 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: clock source: unix Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: pcre jit disabled Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: detected number of CPU cores: 4 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: current working directory: / Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: detected binary path: /usr/bin/uwsgi-core Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: your processes number limit is 47680 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: your memory page size is 4096 bytes Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: detected max file descriptor number: 2048 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: lock engine: pthread robust mutexes Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: thunder lock: enabled Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 16 00:42:05.624127 dv-cinder-master-3-smb devstack@keystone.service[81451]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 16 00:42:05.662700 dv-cinder-master-3-smb devstack@keystone.service[81451]: Python main interpreter initialized at 0x55f07e3ca9c0 Oct 16 00:42:05.662700 dv-cinder-master-3-smb devstack@keystone.service[81451]: python threads support enabled Oct 16 00:42:05.662700 dv-cinder-master-3-smb devstack@keystone.service[81451]: your server socket listen backlog is limited to 100 connections Oct 16 00:42:05.662700 dv-cinder-master-3-smb devstack@keystone.service[81451]: your mercy for graceful operations on workers is 90 seconds Oct 16 00:42:05.663090 dv-cinder-master-3-smb devstack@keystone.service[81451]: mapped 403077 bytes (393 KB) for 2 cores Oct 16 00:42:05.663090 dv-cinder-master-3-smb devstack@keystone.service[81451]: *** Operational MODE: preforking *** Oct 16 00:42:05.663407 dv-cinder-master-3-smb devstack@keystone.service[81451]: *** uWSGI is running in multiple interpreter mode *** Oct 16 00:42:05.663407 dv-cinder-master-3-smb devstack@keystone.service[81451]: spawned uWSGI master process (pid: 81451) Oct 16 00:42:05.663633 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 16 00:42:05.664261 dv-cinder-master-3-smb devstack@keystone.service[81451]: spawned uWSGI worker 1 (pid: 81465, cores: 1) Oct 16 00:42:05.664522 dv-cinder-master-3-smb devstack@keystone.service[81451]: spawned uWSGI worker 2 (pid: 81466, cores: 1) Oct 16 00:42:05.664689 dv-cinder-master-3-smb devstack@keystone.service[81451]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 16 00:42:09.854486 dv-cinder-master-3-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:09.854486 dv-cinder-master-3-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Oct 16 00:42:09.855348 dv-cinder-master-3-smb devstack@keystone.service[81466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:09.855348 dv-cinder-master-3-smb devstack@keystone.service[81466]: from cryptography.utils import int_from_bytes Oct 16 00:42:09.855480 dv-cinder-master-3-smb devstack@keystone.service[81465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:09.855480 dv-cinder-master-3-smb devstack@keystone.service[81465]: from cryptography.utils import int_from_bytes Oct 16 00:42:09.855906 dv-cinder-master-3-smb devstack@keystone.service[81465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 16 00:42:09.855906 dv-cinder-master-3-smb devstack@keystone.service[81465]: from cryptography.utils import int_from_bytes Oct 16 00:42:09.904197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:42:09.904386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:42:09.904555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] command line args: [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:42:09.904812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 16 00:42:09.904962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:42:09.904962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ================================================================================ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:42:09.905102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 16 00:42:09.905173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] command line args: [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 16 00:42:09.905231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.905455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 16 00:42:09.905586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_dir = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.905664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ================================================================================ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 16 00:42:09.905737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.905796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] config_source = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.905852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] admin_token = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.905968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] debug = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_dir = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] config_source = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] debug = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.906917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_config_append = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_dir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.907948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_config_append = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_dir = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.908970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.909947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.910988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.911922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] publish_errors = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] publish_errors = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.912939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] standard_threads = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.913937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] standard_threads = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_journal = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_json = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_stderr = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] use_syslog = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_journal = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.914900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_json = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.915013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_stderr = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.915104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.915175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] use_syslog = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.915284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.915402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 16 00:42:09.915564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.915704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.915790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.915868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916358 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.916940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.917993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.918904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919897 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.919972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.920972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.921975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.922887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.923970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.924997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.925896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.926962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.927943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.928880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929605 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.929918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.930965 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.931995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932302 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.932945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.933967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934838 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.934973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.935978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.936954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937025 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.937998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938455 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.938907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.external = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.939911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.password = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.940927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.external = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] auth.token = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.password = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.941934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] auth.token = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.942977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.943964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.944958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.945879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.946987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.947933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.948997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949605 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.949924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950844 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.950990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.951925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.952959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.953912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.954976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.955996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.956950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.957871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.958966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.959914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.960830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.961938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.962960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.963889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.964990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.965923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.966934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.967861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.968970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.969978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.970923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.971858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.972970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.973974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.974991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.975941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.976989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.977951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.978991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979838 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.979916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980302 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.980895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.981948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.982968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.983901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.984856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.985997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.986998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.987924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.988890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.989996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.990133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.990210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.990281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:42:09.990379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.990611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.990849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.991084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 16 00:42:09.991252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 16 00:42:10.019472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.019735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.019926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.020323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.020558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.020780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.028189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.029105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.055761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.055957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.056825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.057083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.109116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.109257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.156893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.157120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.157572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.157807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.314987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.315957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.316028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.316112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.338646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.338778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.338876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.339969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.340051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.350886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.351278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.363488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.363621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.363702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.363875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.364475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.365046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.365122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.365199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.365324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 16 00:42:10.381677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.381842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:10.382212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.382364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:10.382453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.382634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:10.382763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.382910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 16 00:42:10.383291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.383936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.384184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.392868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.393171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.393434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.393707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.393831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.394067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.394335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.394622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.400648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.401758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.403532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.403810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.404088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.404366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.404643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.404766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.404892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.404973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405679 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.405973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.406099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.406207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.406298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.406505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.406773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.407042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.407307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.428756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.430030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.430195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.430492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.431507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.431790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.435105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.435382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.435661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.436453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.436737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.437043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.441948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.442233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.443424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.443706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.447762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.448050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.448333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.448619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.448891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.449178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.449301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.449417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.449594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.449693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.449921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.450211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.450497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.450774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.451050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.451308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.465050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.465327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.466786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.467064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.469169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.470883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.472354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.472646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.474129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.474430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.476870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.478586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.479955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.481679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.483159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.483453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.483729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.484006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.484289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.484574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.484862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.485160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.485447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.485730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.485997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.486279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.500606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.500869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.501164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.501421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.502407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.502692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.502955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.503192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.508207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.509768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.510122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.511268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.511536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.511659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.513211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.513475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.514197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.514472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.514748 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.515033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.515413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.516175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.516458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.516742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.517060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.517428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.526564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.526846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.527121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.527394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.527764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.528047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.528326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.528645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.528957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.529242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.529506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.529885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.530165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.530445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.543590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.545895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.546480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.548797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.549401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.550814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.551721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.552282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.552582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.553016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.553259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.554713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.554993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.555399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.559300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.560726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.561794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.563251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.563608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.564001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.564280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.564550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.566149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.566542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.566829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.567110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.572312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.572595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.572856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.574993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.575281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.575562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.579688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.579968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.580241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.580514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.580768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.581068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.581341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.581611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.581871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.582142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.582415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.582542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 16 00:42:10.582638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.582726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.582978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.583072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.583245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.583337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.583586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.583850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.584127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.584403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.584683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.584989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.585266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.585525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.585797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.586051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 16 00:42:10.617368 dv-cinder-master-3-smb devstack@keystone.service[81466]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f07e3ca9c0 pid: 81466 (default app) Oct 16 00:42:10.620406 dv-cinder-master-3-smb devstack@keystone.service[81465]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f07e3ca9c0 pid: 81465 (default app) Oct 16 00:42:10.620532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c25d8-ce87-4569-9797-e3f8b45223b1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:10.620805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c25d8-ce87-4569-9797-e3f8b45223b1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:10.621098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c25d8-ce87-4569-9797-e3f8b45223b1 None None] PATH_INFO: `/v3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:10.625315 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Sun Oct 16 00:42:10 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:17.376263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:17.377127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:17.377127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:17.384222 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:17.392901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:17.393440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:17.393440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:17.463016 dv-cinder-master-3-smb devstack@keystone.service[81466]: INFO dbcounter [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] Registered counter for database keystone Oct 16 00:42:17.483990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG oslo_db.sqlalchemy.engines [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:42:17.494018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writer thread running {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:42:17.688226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81466) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:42:17.688540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG passlib.handlers.bcrypt [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81466) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:42:17.757371 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:17.759011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:17.892897 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:42:18.353597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:18.427959 dv-cinder-master-3-smb devstack@keystone.service[81465]: INFO dbcounter [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] Registered counter for database keystone Oct 16 00:42:18.453439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 16 00:42:18.461405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writer thread running {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 16 00:42:18.580007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca2c8c-f530-4332-8c2f-78b5d5e99fbb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:18.585541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:18.586165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:18.586440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:18.586704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:18.595863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:18.647185 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:42:18.647464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17699e-f22e-4a0a-a949-58bbff42d83b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:18.657474 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Sun Oct 16 00:42:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:42:18.664597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:18.686978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1785-8e0b-47c7-a4bf-d3e030f3fbf1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:18.692778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:18.693925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:18.694207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:18.694468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] PATH_INFO: `/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:18.696194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] RBAC: Authorizing `identity:get_project(project_id=76fd6f2e827447f4be188ab2a5fb6b88)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:18.748921 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 16 00:42:18.749255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394e808-24af-4061-9dcf-5ee103521d1d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:18.753783 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:42:18 2022] GET /identity/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:20.951994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02fd5-717a-4639-a9e6-41d25d6eb323 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:20.952548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02fd5-717a-4639-a9e6-41d25d6eb323 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:20.952548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf02fd5-717a-4639-a9e6-41d25d6eb323 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:20.956698 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:20.963652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:20.964353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:20.964466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:20.996146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:20.997717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:21.007701 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:42:21.278195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02fd5-717a-4639-a9e6-41d25d6eb323 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:21.295566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf02fd5-717a-4639-a9e6-41d25d6eb323 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:21.301532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:21.302136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:21.302413 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:21.302684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:21.310535 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:21.312346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290c1b5-e7b1-4879-a438-14588627fcf5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:21.321145 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Sun Oct 16 00:42:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:42:21.326789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:21.336867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482649a8-f95c-415e-bd53-832755c854d7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:21.343339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:21.343961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:21.344233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:21.344494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] PATH_INFO: `/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:21.346049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] RBAC: Authorizing `identity:get_user(user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:21.347901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96abd0-faf5-4140-96bc-6d717f84cb56 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:21.349568 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Sun Oct 16 00:42:21 2022] GET /identity/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:23.515579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbab73-e05b-456d-9abe-c49528466503 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:23.516150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbab73-e05b-456d-9abe-c49528466503 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:23.516150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbab73-e05b-456d-9abe-c49528466503 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:23.517479 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:23.522829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:23.523261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:23.523349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:23.541784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:23.542955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:23.571009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fd2b-5cd0-4dc2-bbe7-ed308fe0954a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:23.571291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fd2b-5cd0-4dc2-bbe7-ed308fe0954a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:23.571555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046fd2b-5cd0-4dc2-bbe7-ed308fe0954a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:23.572902 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 6/11] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:23.577922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f052-26fe-4335-9166-3732b600717d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:23.578202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f052-26fe-4335-9166-3732b600717d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:23.578450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2f052-26fe-4335-9166-3732b600717d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:23.621959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG passlib.handlers.bcrypt [None req-cec2f052-26fe-4335-9166-3732b600717d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81465) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 16 00:42:23.622350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG passlib.handlers.bcrypt [None req-cec2f052-26fe-4335-9166-3732b600717d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81465) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 16 00:42:23.623278 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:23.670600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-cec2f052-26fe-4335-9166-3732b600717d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:23.672199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cec2f052-26fe-4335-9166-3732b600717d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:23.772741 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:23.883103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:23.909385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:23.991385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718af11-e56f-4b80-81d5-2c4e79a59858 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.025530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.026102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.026377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.026642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.034198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2f052-26fe-4335-9166-3732b600717d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.038467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:24.047337 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:24.048283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:24.049553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 7/14] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:42:24.054430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.136381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:24.136690 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2f052-26fe-4335-9166-3732b600717d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.139170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:24.155974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1bdad-5606-42ca-ae2b-fe81f571ffe7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.174768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.175735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.176080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.176349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.177342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.178788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.189506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.190068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.sql.core [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:42:24.190068 dv-cinder-master-3-smb devstack@keystone.service[81465]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:42:24.190068 dv-cinder-master-3-smb devstack@keystone.service[81465]: [parameters: {'id': '7a19f87b77294928a862362bcb44669e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:42:24.190068 dv-cinder-master-3-smb devstack@keystone.service[81465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:42:24.190371 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.190371 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.190659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.191295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:24.191591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.193050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.204735 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 8/15] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:42:24.208515 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:42:24.209396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application yield resource Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise self.value Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application session.commit() Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:42:24.210290 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:42:24.211135 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:42:24.212011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:42:24.212803 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [parameters: {'id': '7a19f87b77294928a862362bcb44669e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:42:24.213615 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:24.214349 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.215149 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 8/16] 10.222.0.13 () {60 vars in 1137 bytes} [Sun Oct 16 00:42:24 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:24.215803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.215875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.310490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abdc20-64d0-4fdc-89cf-79a2941dfaab None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.316468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe56f7-96b3-4816-bdde-eefbc3b145c3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.342134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.342754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.343026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.343289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] PATH_INFO: `/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.344426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] RBAC: Authorizing `identity:get_user(user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.345927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.347527 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 9/17] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:24 2022] GET /identity/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:24.349398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.350261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.350538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.350807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.353282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.368133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:24.369347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.370855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:42:24.386856 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:24.387788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:42:24.388858 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:42:24.388858 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:42:24.388858 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:24.388858 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 9/18] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:42:24.393693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.414663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:24.454791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367868e5-48cb-45fb-957f-d700f424c50a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.488032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.488662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.489366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.489606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.490856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.492204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.493763 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 10/19] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:24.494693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280492d5-dc34-48d9-b8ab-c46a6a5ac7e5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.499587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:24.530944 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.531568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.531812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.532107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.532741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:24.533064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.534452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b4039-bc57-4b46-90c1-eedd139672b8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.551726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 10/20] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:24.581297 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:24.602890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e409c-79a4-417e-ba16-2cebf1365c49 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:24.640487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:24.641193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:24.641464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:24.641732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] PATH_INFO: `/v3/domains/default/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:24.643807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:24.645435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590545d9-f696-4659-a6d3-d533c58cedae None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:24.760869 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 11/21] 10.222.0.13 () {58 vars in 1361 bytes} [Sun Oct 16 00:42:24 2022] PUT /identity/v3/domains/default/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:42:26.963623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c769-89e4-4ad4-8586-4f6bbb342523 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:26.964181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c769-89e4-4ad4-8586-4f6bbb342523 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:26.964181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0c769-89e4-4ad4-8586-4f6bbb342523 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:26.965790 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 11/22] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:26.971383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed791-6963-4ce5-83ac-e0f9847365d0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:26.971781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed791-6963-4ce5-83ac-e0f9847365d0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:26.971961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aed791-6963-4ce5-83ac-e0f9847365d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.002046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-44aed791-6963-4ce5-83ac-e0f9847365d0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:27.003597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-44aed791-6963-4ce5-83ac-e0f9847365d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:27.103390 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 12/23] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:27.163331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b425-8012-4f4f-a276-8f19df92541a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.163636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b425-8012-4f4f-a276-8f19df92541a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.163871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b425-8012-4f4f-a276-8f19df92541a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.165399 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:27.170442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.170729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.171002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.197979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:27.199204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:27.269649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:27.274888 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 13/25] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:27.543018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b425-8012-4f4f-a276-8f19df92541a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:27.652422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:27.677970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b425-8012-4f4f-a276-8f19df92541a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:27.724048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:27.724749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.725045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.725308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.737998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:27.739946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:42:27.757579 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:27.758447 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:42:27.759262 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:42:27.759262 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:42:27.759262 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:27.759262 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 13/26] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:27.765737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:27.773877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:27.912591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e9796-e202-4e3c-be7d-05ba7c45c1ec None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:27.918976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cb1f5-f7f6-4d19-b8f4-73eca1e7f8b2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:27.951237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:27.957976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:27.958903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.959399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.959892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.964869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:27.965487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.965767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.966037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.966692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:27.966991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:27.968949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9811a-d03a-411f-9351-87bc64f631b0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:27.975435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2b56d04a-67e2-473a-bfc0-31bb61083d09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:27.983742 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:27.984600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:27.985368 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:27.987045 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 14/27] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:42:27.987330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47589fed-6050-49dc-8eef-d8d21ca8f2a3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.987608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47589fed-6050-49dc-8eef-d8d21ca8f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.987878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47589fed-6050-49dc-8eef-d8d21ca8f2a3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 15/28] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdbc-9cbb-4b6e-b33c-b34e1912301b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdbc-9cbb-4b6e-b33c-b34e1912301b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeacdbc-9cbb-4b6e-b33c-b34e1912301b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 16/29] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:27.994886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacdbc-9cbb-4b6e-b33c-b34e1912301b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.002065 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 14/30] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:28.007209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c047fa-4166-44c2-8065-394467cd4570 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.007730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c047fa-4166-44c2-8065-394467cd4570 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.008239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c047fa-4166-44c2-8065-394467cd4570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.026995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a1c047fa-4166-44c2-8065-394467cd4570 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:28.028625 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a1c047fa-4166-44c2-8065-394467cd4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:28.086789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:28.099703 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 15/31] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:28.101395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.101925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.102405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.121452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:28.122979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:28.124810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeacdbc-9cbb-4b6e-b33c-b34e1912301b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:28.172433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:28.174693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.175812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.176478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.180720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:28.182565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:28.184195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:28.211129 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 17/32] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:28.218259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.224223 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 16/33] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:28.225452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.343609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:28.419831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6637a-b3a0-4112-8b8e-eee5eeed4e43 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:28.442300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402bcd6-accb-46c2-92e0-4f34e3382f0e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:28.451557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:28.468114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:28.468757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.469208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.469460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] PATH_INFO: `/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.470753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:28.472164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc11cb-c25c-414f-95b9-421140d1ee21 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:28.479058 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 17/34] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:28 2022] GET /identity/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:28.480424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4730be7-73ed-4ad6-b2e3-7b41a2537257 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.480708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4730be7-73ed-4ad6-b2e3-7b41a2537257 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.481030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4730be7-73ed-4ad6-b2e3-7b41a2537257 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.482444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:28.482582 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 18/35] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:28.483246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4730be7-73ed-4ad6-b2e3-7b41a2537257 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.483769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.484246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.484714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.485583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:28.487320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:28.594677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4730be7-73ed-4ad6-b2e3-7b41a2537257 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:28.630669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:28.631280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.631559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.631818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.632486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:28.633081 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 18/36] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/projects => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:28.633911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c44e61-666b-41a1-9c31-407580f86b0e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:28.634474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.673749 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/roles => generated 225 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:28.675787 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.676179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.676464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.820044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3295-8619-444e-a3a4-5f2f3a54de53 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:28.829642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:28.875960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:28.877071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:28.877553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:28.878044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:28.885975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:28.888035 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:28.890145 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:28.891199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:28.910009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:28.911356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:28.962072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:28.991890 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:28.993186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:29.020524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97b8b-2a35-4431-a896-148da321857b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:29.074390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:29.075411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.075411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.075573 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.076193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:29.077658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1fe5f-357e-4509-a898-e01d1f857d74 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:29.098297 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 16 00:42:28 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:29.100186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1f0a-812a-4787-90e5-d0c9296105e3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.100541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1f0a-812a-4787-90e5-d0c9296105e3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.101591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f1f0a-812a-4787-90e5-d0c9296105e3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.102362 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 21/41] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:29.108126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.108413 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.109458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.122613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a106c63-bcc3-4130-9adc-0357c7fd5acb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:29.134038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:29.136176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:29.162395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:29.163102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.163388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.163667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.164520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.domain.id=default, user.id=1cfb0a7e76e5448c9456b4ef4f0b5fd7) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:29.164856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:29.166453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:29.167509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:29.175087 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 21/42] 10.222.0.13 () {56 vars in 1322 bytes} [Sun Oct 16 00:42:28 2022] GET /identity/v3/role_assignments?user.id=1cfb0a7e76e5448c9456b4ef4f0b5fd7&scope.domain.id=default&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 530 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:29.219973 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:29.274691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:29.327554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:29.396311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008ea9-ab97-463f-aaa8-0efca3a13c9c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:29.429963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:29.430583 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.430857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.431126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.431788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:29.433224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:29.448975 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 16 00:42:29 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:29.495128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:29.601970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ccb19-075f-4911-ad92-4296f8c8e215 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:29.638174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:29.638849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.639093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.639893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.640735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:29.642247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e19bdb-c87b-4c48-9b99-a5ad2673bc3b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:29.643814 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 23/45] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:29.649650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:29.750807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796ae90-c4b9-4522-8f8a-78641fd13b09 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:29.752365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:29.790609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:29.791216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:29.791493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:29.791766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:29.792425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:29.793916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93f127-7d3f-4142-8050-7d093396331b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:29.824342 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:42:29 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:31.934576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8b4c-7ceb-49b8-8ab8-11da3af8c9cf None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:31.935417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8b4c-7ceb-49b8-8ab8-11da3af8c9cf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:31.935417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8b4c-7ceb-49b8-8ab8-11da3af8c9cf None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:31.937462 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 24/47] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:31.943964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:31.944630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:31.944770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:31.974159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:31.975379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:32.045929 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:32.312006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8b4c-7ceb-49b8-8ab8-11da3af8c9cf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:32.353264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:32.429259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d8b4c-7ceb-49b8-8ab8-11da3af8c9cf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:32.464435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:32.465080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:32.465352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:32.465617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:32.466856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:32.468322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612062ee-aa95-4d28-9529-6cbd982a7df2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:32.469901 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 25/49] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:32.476219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:32.574637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:32.597365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fa85-06d3-4f4f-a912-36f7a66510ad None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:32.633207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:32.633807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:32.634082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:32.634351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:32.634994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:32.636450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092ad7c-8ec6-4eae-8a06-c5d41479864f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:32.667137 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1140 bytes} [Sun Oct 16 00:42:32 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:34.786195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c149-f982-4e2c-9a9d-a13776ec3c12 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:34.787079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c149-f982-4e2c-9a9d-a13776ec3c12 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:34.787079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c149-f982-4e2c-9a9d-a13776ec3c12 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:34.789337 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 26/51] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:34.795459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:34.795876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:34.796080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:34.822541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:34.823734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:34.895201 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:35.169227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c149-f982-4e2c-9a9d-a13776ec3c12 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:35.275223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:35.279689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c149-f982-4e2c-9a9d-a13776ec3c12 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:35.316628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:35.317317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:35.317594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:35.317866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:35.319144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:35.320625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358e498-c758-48e8-8a92-9a6e0caa73b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:35.322222 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:35.328013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:35.398045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:35.432555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fef1a6-17f4-4371-8280-e9a82a690a55 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:35.480097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:35.480703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:35.481007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:35.481288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:35.481932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:35.483416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28840e-6f61-4fef-a637-520571ee5a61 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:35.513326 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 27/54] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:35 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:38.782372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d372-63a5-4c8f-8528-60abdcde708b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:38.782889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d372-63a5-4c8f-8528-60abdcde708b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:38.782960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213d372-63a5-4c8f-8528-60abdcde708b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:38.784333 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 28/55] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:38.789634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7154-876e-41aa-aab9-0db487aea538 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:38.790023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7154-876e-41aa-aab9-0db487aea538 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:38.790206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7154-876e-41aa-aab9-0db487aea538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:38.811323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d870-d46a-472f-a8f6-4f263e5f38cc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:38.811625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d870-d46a-472f-a8f6-4f263e5f38cc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:38.811877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d870-d46a-472f-a8f6-4f263e5f38cc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:38.813338 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 29/56] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:38.821888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d07e7154-876e-41aa-aab9-0db487aea538 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:38.823137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d07e7154-876e-41aa-aab9-0db487aea538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:38.827039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afacf1-ab90-44f0-adc5-65682cf75258 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:38.827569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afacf1-ab90-44f0-adc5-65682cf75258 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:38.828028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afacf1-ab90-44f0-adc5-65682cf75258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:38.856851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-22afacf1-ab90-44f0-adc5-65682cf75258 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:38.858039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-22afacf1-ab90-44f0-adc5-65682cf75258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:38.921648 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 28/57] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:38.979728 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 30/58] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 16 00:42:39.143919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1879-1c67-406f-8cb3-09d029b152ca None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.144611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1879-1c67-406f-8cb3-09d029b152ca None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.145115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1879-1c67-406f-8cb3-09d029b152ca None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.146732 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 29/59] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:39.151977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.152267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.152542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.181246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:39.182469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:39.278404 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:39.311251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1879-1c67-406f-8cb3-09d029b152ca None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.331193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.369708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:39.394032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:39.442721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1879-1c67-406f-8cb3-09d029b152ca None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:39.454214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7d849-047c-4553-bcce-423f3267d293 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:39.478668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:39.479318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.479564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.479856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.492656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-71b5f75d-444a-4a50-829e-ed3539eb35de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:39.497641 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:39.498512 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:39.499298 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:39.500626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4863-ec1f-4260-811d-44bec448da1a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.501034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4863-ec1f-4260-811d-44bec448da1a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.501194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d4863-ec1f-4260-811d-44bec448da1a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.503846 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 31/62] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:39.503846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc76-ee3a-4f7a-a7dd-7748216cb3fa None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.503846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc76-ee3a-4f7a-a7dd-7748216cb3fa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.504093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9dc76-ee3a-4f7a-a7dd-7748216cb3fa None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.505427 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:39.508814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9dc76-ee3a-4f7a-a7dd-7748216cb3fa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.607511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:39.608149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.608423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.608687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.612423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9dc76-ee3a-4f7a-a7dd-7748216cb3fa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:39.619394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cbed77e7-dccd-4c82-b272-6f3d640fad11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:39.624513 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:39.625431 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:39.626193 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:39.626762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:39.626827 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 32/64] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:39.626827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.626946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.627443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.647715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:39.648814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:39.648981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:39.649450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.649721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.649987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.650618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:39.650918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:39.652308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc144c-b1c6-4d8e-8040-f7022dc77fcf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:39.660079 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 33/65] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:39.664720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.664720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.664720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.679544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:39.680732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:39.720455 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 33/66] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:39.721347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.747526 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 34/67] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:39.748654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.763698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:39.863000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458d304-5199-40e6-baac-77fe00071cbf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:39.872706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cba6d-33ac-46ab-8b51-2154ca595805 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:39.875735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:39.899997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:39.900637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.900964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.901410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.911514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:39.912636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:39.913479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:39.913945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:39.914402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:39.915267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:39.915764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:39.916421 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:39.917260 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:39.918005 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 34/68] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:39.918628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:39.920132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:39.929462 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:39.930717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.002932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.024223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1424b74b-c017-4879-b693-c04ba55fa459 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.033939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352685-420c-4817-9ba5-5870890b53a8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.058001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.058630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.058901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.059166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.065908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.066528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.066820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.067091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.067751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:40.068048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.069488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.074282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.075711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.077378 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.078143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.083037 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.083783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.110737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.180364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26efae5-d6af-41b6-b5e9-6cd430504ff7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.183653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b87409-7c87-4246-b0ff-5d6055c9e616 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.212434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.213090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.213369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.213635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.218813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.219464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.219737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.220004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.221210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.222764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.223385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:40.224389 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.224389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:40.229147 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:40.230106 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:40.231057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.235260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.317285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.329606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c181d-3c33-4406-845c-1e1fe18b59cf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.332337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afceead-8d57-41a5-8779-84cf74c60bb8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.361397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.362010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.362282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.362547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.365328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.365626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.365953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.366230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.366501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.367293 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 38/74] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.372294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.372390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.372461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.372461 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.372461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.443533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.465462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af96aff-a376-4a50-9e2a-3cbe6fa66dd8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.473438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ec3e4-c44e-4906-be89-36da0ca8015d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.497560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.498189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.498466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.498739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] PATH_INFO: `/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.499871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] RBAC: Authorizing `identity:get_user(user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.501447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.503141 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 39/76] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.503733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.508773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.509429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.510202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.510474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.511625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.513082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.514701 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 38/77] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.515423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.528277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.598652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc418541-226e-48f3-9bd7-8b706b85815b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.614313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0df0b0-df0f-4afe-85e8-2ed1be130132 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.631324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.631929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.632205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.632475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.633189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:40.633469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.634874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.642699 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 40/78] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.643448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.648801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.649484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.649761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.650020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/users/771d44da2ee847eabd7802b16a03e281/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.652143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, user_id=771d44da2ee847eabd7802b16a03e281, role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.653608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.665461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.670154 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:40 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/users/771d44da2ee847eabd7802b16a03e281/roles/8580d6ffb0314695b7d97c77052b2597 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:40.670932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.744229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:40.761422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc5f78-543a-439e-917f-c64784ef4e89 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.798799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.799470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.799755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.800032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.800763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.802355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.805637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365b768-9430-437b-a177-79abd24f0ae1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.836874 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 41/80] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:40 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:40.836874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.859878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:40.860557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:40.860818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:40.861119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:40.862794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:40.865095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:40.868621 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 40/81] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:40.873448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:40.962077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b745b53-35a9-42a4-9fd3-e0aee858ec98 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:40.993019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:41.023229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:41.023918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:41.024191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:41.025806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/users/771d44da2ee847eabd7802b16a03e281/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:41.027663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, user_id=771d44da2ee847eabd7802b16a03e281, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:41.033268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:41.054441 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:40 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/users/771d44da2ee847eabd7802b16a03e281/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:41.061026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:41.061884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc19207-2a23-4eac-8005-5356809476ac None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:41.084922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:41.204509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608ed1-e4f6-48b7-be1a-3d604008d26d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:41.209771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:41.211447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:41.212113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:41.213366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:41.217178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:41.219792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:41.222792 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 41/83] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:40 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:41.229530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:41.305791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:41.306416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:41.306696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:41.306971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:41.311076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:41.312702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:41.342169 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:41 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:41.419983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd16f-fa84-470a-85d7-970f2690698a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:41.490517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:41.491625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:41.492156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:41.492624 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] PATH_INFO: `/v3/projects/bc066f3921094f04a46f94964433609a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:41.497774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] RBAC: Authorizing `identity:get_project(project_id=bc066f3921094f04a46f94964433609a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:41.499565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3b802-4f21-4930-9bee-664b0cfa0020 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:41.502036 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 42/85] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:41 2022] GET /identity/v3/projects/bc066f3921094f04a46f94964433609a => generated 312 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:41.508096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:41.607634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:41.663513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f69721-260c-4c29-b24f-96fef61c3d8b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:41.709176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:41.710252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:41.710751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:41.711213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] PATH_INFO: `/v3/projects/bc066f3921094f04a46f94964433609a/users/771d44da2ee847eabd7802b16a03e281/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:41.718193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc066f3921094f04a46f94964433609a, user_id=771d44da2ee847eabd7802b16a03e281, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:41.719905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1aa98-e556-4dfb-8089-424f637c6c92 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:41.748891 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:41 2022] PUT /identity/v3/projects/bc066f3921094f04a46f94964433609a/users/771d44da2ee847eabd7802b16a03e281/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:43.575990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c798b-c011-4a83-bf67-b80abd4d95d8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:43.576513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c798b-c011-4a83-bf67-b80abd4d95d8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:43.576513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c798b-c011-4a83-bf67-b80abd4d95d8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:43.578011 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 43/87] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:43.583937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0617-971c-44b3-8383-5a454c5809e5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:43.584920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0617-971c-44b3-8383-5a454c5809e5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:43.585411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce0617-971c-44b3-8383-5a454c5809e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:43.610908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-62ce0617-971c-44b3-8383-5a454c5809e5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:43.612502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-62ce0617-971c-44b3-8383-5a454c5809e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:43.686481 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 45/88] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:43.835222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad345a0-0462-44bc-bb55-f6b9f306271b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:43.835826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad345a0-0462-44bc-bb55-f6b9f306271b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:43.836293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad345a0-0462-44bc-bb55-f6b9f306271b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:43.837889 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 44/89] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:43.853610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca6-3137-4b42-a94f-0b2cc85d66e3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:43.854221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca6-3137-4b42-a94f-0b2cc85d66e3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:43.854704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3cca6-3137-4b42-a94f-0b2cc85d66e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:43.874811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-55d3cca6-3137-4b42-a94f-0b2cc85d66e3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:43.876318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55d3cca6-3137-4b42-a94f-0b2cc85d66e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:43.928541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:43.953868 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 46/90] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:44.115685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad345a0-0462-44bc-bb55-f6b9f306271b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.120728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:44.150902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe82df-421b-4258-ac40-c79cdb242f00 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.151229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe82df-421b-4258-ac40-c79cdb242f00 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.151443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe82df-421b-4258-ac40-c79cdb242f00 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.152966 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 47/91] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:44.157946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.158225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.158495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.193885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:44.195170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:44.286604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad345a0-0462-44bc-bb55-f6b9f306271b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:44.324880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:44.325858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.326318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.326751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.340551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:44.346990 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:44.347901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:44.348657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:44.351594 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 45/92] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:44.355395 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:44.361632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.365388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.431063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:44.474360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ebd4-bcaa-4cea-bdaa-69b893689f43 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:44.511726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:44.513011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.513484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.513980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.514838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:44.515327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:44.516933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb665e-c76e-490e-a09a-139cc973aceb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:44.527343 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 46/94] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:44.529352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570179-8cd9-42c1-ad04-f9a34883722e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.530416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570179-8cd9-42c1-ad04-f9a34883722e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.530885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30570179-8cd9-42c1-ad04-f9a34883722e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.532697 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 47/95] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:44.542164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.542449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.542723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.560743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf9f06-dff0-44e1-9ab1-22618bf2eeb0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:44.574254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:44.579057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:44.580300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:44.605519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:44.606984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.607326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.607593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.628036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:44.634350 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:44.635164 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:44.636363 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 49/96] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:42:44.637232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.689826 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 48/97] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:44.691157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.793013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:44.842401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014f6bd-ca14-4eb6-9513-e28cfa7aa171 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:44.877269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813133fe-c816-4bcf-bb3e-b54653cdccc7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:44.905432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:44.906083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.906354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.906624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.910659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:44.912181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:44.915708 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 50/98] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:44.918990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.941331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:44.941878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:44.942156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:44.942427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:44.943094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:44.943393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:44.944787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:44.957603 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 49/99] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:44.958741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:44.982308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.056513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc05645-c316-4646-89c1-2ecbf4d88de5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.086501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4bd0-22b7-4ac0-8802-944451b62e4b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.098265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.099000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.099192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.099468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.100581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.102095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfd5ca-0106-499d-b099-31492e1314c2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.103805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.104162 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 51/100] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:45.105403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927a19-eedd-4e6a-94a3-1f6df79acdd1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.105684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927a19-eedd-4e6a-94a3-1f6df79acdd1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.106008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a927a19-eedd-4e6a-94a3-1f6df79acdd1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.108985 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 52/101] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:45.108985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927a19-eedd-4e6a-94a3-1f6df79acdd1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.126343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.126983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.127248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.127480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.206122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.207539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.220517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a927a19-eedd-4e6a-94a3-1f6df79acdd1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.231239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.259684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.260323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.260604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.260901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] PATH_INFO: `/v3/users/edcdd0304cbc447aaa3ed0d07f9d7455` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.274963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] RBAC: Authorizing `identity:get_user(user_id=edcdd0304cbc447aaa3ed0d07f9d7455)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.276441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.278163 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 53/102] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/users/edcdd0304cbc447aaa3ed0d07f9d7455 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:45.283509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.325473 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 50/103] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:45.326706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.348227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.387546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b6b42-43e4-40a0-828f-c67b82db6fbb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.420621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.421268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.421549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.421815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.426920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466a52f-cc26-4560-840b-931a2cbc41cd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.432501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2dde4eaf-9a1f-441b-a949-a8d10f777181 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:45.437329 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:45.438171 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:45.438977 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 54/104] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:45.439614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.440052 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.440205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.458010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:45.459147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:45.464166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.464775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.465082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.465349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.465989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.467440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.479714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.508866 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 51/105] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:42:45 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:45.508866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.536142 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 55/106] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:45.537873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.578236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.616767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d3349-5a07-4730-99e9-f7a4f733be8e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.656918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.657652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.657995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.658246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.659580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.661187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380ac2b-5e8c-4a67-a134-50c88c118ad8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.663207 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 52/107] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:45.664679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbfc5-dd82-471a-8898-745ef85ad932 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.664932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbfc5-dd82-471a-8898-745ef85ad932 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.665204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cbfc5-dd82-471a-8898-745ef85ad932 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.666811 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 53/108] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:45.667239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbfc5-dd82-471a-8898-745ef85ad932 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.680493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df2478-7efc-4216-b414-cd522f563e45 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.721455 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.722186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.722589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.722811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.724146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.725785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.727731 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 56/109] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:45.729359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.765962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.796759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cbfc5-dd82-471a-8898-745ef85ad932 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.833019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.833641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.833925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.834202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.834871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:45.835177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.836575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431012e9-bd65-4689-8ef4-face0b0739e8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.841833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:45.849143 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 54/110] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:45.850466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.851853 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.852133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.858377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c20d-e14b-4c9a-a69e-5e5f554a1b2b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:45.870926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:45.872084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:45.895473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:45.896149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:45.896422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:45.896695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/users/edcdd0304cbc447aaa3ed0d07f9d7455/roles/0a5185fedde04b5c9f8dc3c796e17281` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:45.900597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, user_id=edcdd0304cbc447aaa3ed0d07f9d7455, role_id=0a5185fedde04b5c9f8dc3c796e17281)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:45.902129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:45.917353 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 57/111] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:45 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/users/edcdd0304cbc447aaa3ed0d07f9d7455/roles/0a5185fedde04b5c9f8dc3c796e17281 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:45.925195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:45.960274 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:45.961334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.050848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.069506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f79f7e-f8fa-4f1f-ba8c-7cb0fc60b2f7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.136773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.137434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.137705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.137981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.138723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] RBAC: Adding query filter params (role.id=8580d6ffb0314695b7d97c77052b2597, scope.project.id=afb24a05230945e78568c5993adc8b60, user.id=771d44da2ee847eabd7802b16a03e281) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:46.139041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.140505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.149692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 58/113] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/role_assignments?user.id=771d44da2ee847eabd7802b16a03e281&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=8580d6ffb0314695b7d97c77052b2597 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:46.149938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.174688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f33ff-23c6-43eb-9120-9b7137987d8e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.228328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.242278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.244070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.244555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.245510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.266162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:46.271865 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:46.272738 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:46.273567 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 56/114] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:46.274182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.275349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59f3f3-973b-42d4-93eb-58796e5ec568 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.333659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.334492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.334781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.335059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.336671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.338719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.340773 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 59/115] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:46.341536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.367299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.400256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7364fb2-2da3-45fd-a686-c9cad50b98b5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.447866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.448674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.449127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.449495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.461354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:46.466868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:46.467965 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:46.468936 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:46.470966 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 57/116] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:46.471993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.474845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915b630-ada1-42d8-bc0e-56993237f0d5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.529742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.530608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.531053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.532019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.532882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:46.533332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.535598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.545246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.551625 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 60/117] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:46.552996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.611200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130abb-5ad8-44c6-ab25-82a7e56a387a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.652242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.653595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.654082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.654526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.655325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.691767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a0216-0417-400f-b809-fb406a92d23f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.728259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.728897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.729175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.729444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.730107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:46.730498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.731991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.738327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.739899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.741168 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 61/118] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:46.742076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.789326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.843015 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 58/119] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:46.844207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.859481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f216b6e-75b4-4ec6-8666-66349b07d362 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.912245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.913091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.913471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.913848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] PATH_INFO: `/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.915396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] RBAC: Authorizing `identity:get_user(user_id=1cfb0a7e76e5448c9456b4ef4f0b5fd7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.917680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:46.919314 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 62/120] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/users/1cfb0a7e76e5448c9456b4ef4f0b5fd7 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:46.920084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:46.934779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:46.954677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a698-a2c9-4271-bb7d-20558f949596 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:46.995801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:46.996441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:46.996711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:46.997003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] PATH_INFO: `/v3/users/771d44da2ee847eabd7802b16a03e281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:46.998141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] RBAC: Authorizing `identity:get_user(user_id=771d44da2ee847eabd7802b16a03e281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:46.999600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.001213 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 59/121] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/users/771d44da2ee847eabd7802b16a03e281 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.001979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.021569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.059951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e0944-37f8-40c2-bfd4-d71f83895665 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.106618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab9367-7359-4f87-bcd6-e473e7d0f13a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.111508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.112470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.113295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.113707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.115093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.116784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.118970 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 63/122] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:46 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.120155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.147261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.147877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.148149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.148417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.206570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.214555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.216051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.233217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af97bee-05cf-40d7-b7c6-3dbc68a2b591 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.233822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.274116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.275137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.275710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.276183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.314303 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 60/123] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:47.315448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.351547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.353920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.413215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b3020-fcdd-4899-b670-d47248958411 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.430604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.440711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.448438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.449086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.449362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.449638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.450366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] RBAC: Adding query filter params (role.id=7b0ec29716c44100940a0056ee094bab, scope.project.id=afb24a05230945e78568c5993adc8b60, user.id=771d44da2ee847eabd7802b16a03e281) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:47.450663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.452405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.461112 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 61/124] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/role_assignments?user.id=771d44da2ee847eabd7802b16a03e281&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=7b0ec29716c44100940a0056ee094bab => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.461951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.471123 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 64/125] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:47.481688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.571468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54e17-98e5-4ec5-af5f-86bb38f08967 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.605723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.606319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.606597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.606868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.608032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.611572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.611572 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 62/126] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.622272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.643068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f468f-d6cc-43f5-a588-ce1effa986d3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.684286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.685063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.685349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.685628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] PATH_INFO: `/v3/projects/bc066f3921094f04a46f94964433609a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.687071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] RBAC: Authorizing `identity:get_project(project_id=bc066f3921094f04a46f94964433609a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.689571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.691670 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 65/127] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/projects/bc066f3921094f04a46f94964433609a => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.697753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:47.716399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.757788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:47.784435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e0d72-7a48-439f-9525-31ec01932f8b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.819146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a22422-c588-4b4f-98d1-ec012f951dfd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:47.822686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.823439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.823818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.824198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.825664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=afb24a05230945e78568c5993adc8b60, user.id=1cfb0a7e76e5448c9456b4ef4f0b5fd7) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:47.825664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.827013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da90f6-a4c7-4db9-aa31-41faaf530d37 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.833701 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 63/128] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/role_assignments?user.id=1cfb0a7e76e5448c9456b4ef4f0b5fd7&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:47.867676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:47.868583 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.869039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.869421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.870342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] RBAC: Adding query filter params (role.id=7b0ec29716c44100940a0056ee094bab, scope.project.id=bc066f3921094f04a46f94964433609a, user.id=771d44da2ee847eabd7802b16a03e281) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:47.870775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:47.872564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bff9e-6868-4107-8787-5e9c5ab6e532 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:47.880457 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 66/129] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:47 2022] GET /identity/v3/role_assignments?user.id=771d44da2ee847eabd7802b16a03e281&scope.project.id=bc066f3921094f04a46f94964433609a&role.id=7b0ec29716c44100940a0056ee094bab => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:47.996592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25fd1-7a4b-485f-87f7-894b98877b94 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:47.996774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25fd1-7a4b-485f-87f7-894b98877b94 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:47.997076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f25fd1-7a4b-485f-87f7-894b98877b94 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:47.998542 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 64/130] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:48.004753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6770-2572-4080-a4a2-b3fa7e396ecd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.005175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6770-2572-4080-a4a2-b3fa7e396ecd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.005520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6770-2572-4080-a4a2-b3fa7e396ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.026109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-90aa6770-2572-4080-a4a2-b3fa7e396ecd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:48.027465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-90aa6770-2572-4080-a4a2-b3fa7e396ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:48.106474 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 67/131] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:48.372810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25fd1-7a4b-485f-87f7-894b98877b94 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:48.469239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269cc6-6cda-4653-b413-ca886260f274 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.469508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269cc6-6cda-4653-b413-ca886260f274 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.469801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269cc6-6cda-4653-b413-ca886260f274 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.471159 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 68/132] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:48.476151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.476414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.477056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.478005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f25fd1-7a4b-485f-87f7-894b98877b94 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:48.492412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:48.495443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:48.496624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:48.512041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16226568-9d79-4561-a088-09d9c366505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:48.512673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16226568-9d79-4561-a088-09d9c366505f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.512972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16226568-9d79-4561-a088-09d9c366505f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.513242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16226568-9d79-4561-a088-09d9c366505f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.514336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16226568-9d79-4561-a088-09d9c366505f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:48.515794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16226568-9d79-4561-a088-09d9c366505f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:48.517410 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 65/133] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:48.523032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16226568-9d79-4561-a088-09d9c366505f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:48.527257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:48.564314 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 69/134] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:48.621644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16226568-9d79-4561-a088-09d9c366505f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:48.655345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:48.655880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.656156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.656425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.657103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:48.658547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:48.686291 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 66/135] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:48 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:42:48.831383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:48.933067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5972-d3f3-4861-a783-5355ff69eb8c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:48.969404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:48.970049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:48.970334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:48.970606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:48.982162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:48.987179 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:48.988370 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:48.989267 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 70/136] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:48.995982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:49.042722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:49.111847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c491a-2b2a-45ce-af0d-9f9bb8652631 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:49.148814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:49.149480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:49.149752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:49.150022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:49.150699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:49.150999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:49.152397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:49.163933 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 67/137] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:49.169869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:49.201778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:49.277680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04800022-05fa-40cb-bc87-5caf3ffb9a18 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:49.312294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:49.312949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:49.313227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:49.313497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] PATH_INFO: `/v3/users/edcdd0304cbc447aaa3ed0d07f9d7455` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:49.314713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] RBAC: Authorizing `identity:get_user(user_id=edcdd0304cbc447aaa3ed0d07f9d7455)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:49.316299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:49.318111 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 71/138] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:49 2022] GET /identity/v3/users/edcdd0304cbc447aaa3ed0d07f9d7455 => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:49.323924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:49.429301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:49.432473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a460b5-411d-4469-8d0e-a89a5d5ba5c8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:49.467446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:49.468037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:49.468320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:49.468594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:49.539148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:49.541033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:49.638801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:49.643716 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 68/139] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:49.649325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:49.755266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:49.762272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5b8f3-841e-4de6-83bd-faa56b759554 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:49.798488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:49.799496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:49.800017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:49.800472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:49.801912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:49.803587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f130c-05de-4f2f-9843-533573d11d1b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:49.805661 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 72/140] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:49 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:49.814101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:49.912786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935dcc1-377c-4f8a-bae5-12bc1b70a968 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:49.949919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:49.950540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:49.950818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:49.951089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:49.951833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] RBAC: Adding query filter params (role.id=0a5185fedde04b5c9f8dc3c796e17281, scope.project.id=afb24a05230945e78568c5993adc8b60, user.id=edcdd0304cbc447aaa3ed0d07f9d7455) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:49.952140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:49.953770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeebb4e-0452-455b-9f5c-ddc0fac86a0d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:49.964978 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 69/141] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:49 2022] GET /identity/v3/role_assignments?user.id=edcdd0304cbc447aaa3ed0d07f9d7455&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=0a5185fedde04b5c9f8dc3c796e17281 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:50.990776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16af28-7b77-4884-8ad2-5514f7dfcb3a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:50.991318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16af28-7b77-4884-8ad2-5514f7dfcb3a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:50.991318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16af28-7b77-4884-8ad2-5514f7dfcb3a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:50.992884 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 73/142] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:50.997922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b351e-6417-4ad9-9b46-6d86d613cb68 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:50.998352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b351e-6417-4ad9-9b46-6d86d613cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:50.998426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b351e-6417-4ad9-9b46-6d86d613cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.017628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7e2b351e-6417-4ad9-9b46-6d86d613cb68 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:51.018977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7e2b351e-6417-4ad9-9b46-6d86d613cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:51.073530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9af1-b910-4df1-b5de-bbf9252a1e82 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.073811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9af1-b910-4df1-b5de-bbf9252a1e82 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.074325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc9af1-b910-4df1-b5de-bbf9252a1e82 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.075884 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 74/143] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:51.081115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb631-f020-4d11-ae2c-1e193c2be56a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.081397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb631-f020-4d11-ae2c-1e193c2be56a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.081667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb631-f020-4d11-ae2c-1e193c2be56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.088272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.098713 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 70/144] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:51.102024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a5dcb631-f020-4d11-ae2c-1e193c2be56a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:51.103267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5dcb631-f020-4d11-ae2c-1e193c2be56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:51.178713 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 75/145] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:51.222540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ba8f-b661-45d4-ad25-13c4c3a64e27 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.222846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ba8f-b661-45d4-ad25-13c4c3a64e27 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.223097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169ba8f-b661-45d4-ad25-13c4c3a64e27 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.224608 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 71/146] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:51.229734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.230020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.230295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.248967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:51.250088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:51.317000 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:51.365787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ba8f-b661-45d4-ad25-13c4c3a64e27 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.449498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.469447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169ba8f-b661-45d4-ad25-13c4c3a64e27 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.474302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.509656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.510512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.511052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.511328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.522384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:51.527237 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:51.528224 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:51.529375 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 72/148] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:51.537077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.554721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81120b2-e0ec-4361-ab01-fcdf2f7a2cee None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.588989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.589619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.589886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.590150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.594594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.600654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:51.605573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:51.606464 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 77/149] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:42:51.608338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.640944 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a441c1-3178-40f4-8eea-208dd538cd9a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.674987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.675597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.675875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.676142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.676802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:51.677129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:51.678546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:51.686514 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 73/150] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:51.687295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.689017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.706683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee834c0-92c9-4bc0-be2b-a03c2aeba665 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.740231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.740880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.741162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.741433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.742565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:51.744047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:51.745853 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 78/151] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:51.746535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.786106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274f160-3df9-4587-a25a-48ef6ad14928 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.801452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.818736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.819342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.819616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.819883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.820547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:51.820928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:51.822254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:51.830307 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 74/152] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:51.832348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.841538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c90d-d743-4e2d-8f82-54bd25594ffc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.875311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.875938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.876215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.876483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] PATH_INFO: `/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.889471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] RBAC: Authorizing `identity:get_user(user_id=f02c4cd2238d4db7a9c4957b1cfac0b3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:51.890942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:51.892555 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 79/153] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:51.893407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:51.904520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:51.935841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d9627-dbee-4e7e-b2ed-c46d8383deb8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.971603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:51.972224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:51.972493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:51.972784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:51.973464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:51.974951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:51.993341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a65e3-63aa-4c37-9bef-258917dda42a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:51.997499 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 75/154] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:51 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:51.998318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:52.032893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:52.033565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:52.033818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:52.034166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] PATH_INFO: `/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:52.035374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] RBAC: Authorizing `identity:get_user(user_id=f02c4cd2238d4db7a9c4957b1cfac0b3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:52.036968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:52.038741 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 80/155] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:52.044318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:52.045091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:52.127142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2629-449d-4a60-bed8-b2cde7540f50 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:52.142155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:52.166172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:52.166824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:52.167104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:52.167439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:52.167802 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb22e2-377b-4c8c-b875-4b1b27cf3558 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:52.168605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:52.170133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:52.171970 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 76/156] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:51 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:52.177841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:52.209516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:52.210162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:52.210431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:52.210695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:52.211839 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:52.215200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:52.215200 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 81/157] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:52 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:52.221091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:52.300812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e362789-484c-47bc-812b-fa3cdf9599ae None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:52.302781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:52.336252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7eb2f-b9fb-45d4-889a-463e4d286a51 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:52.338783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:52.339460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:52.340261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:52.340261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/f02c4cd2238d4db7a9c4957b1cfac0b3/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:52.342137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, user_id=f02c4cd2238d4db7a9c4957b1cfac0b3, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:52.344221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16439371-7e70-4473-9721-13d1e6679249 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:52.364330 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 77/158] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:52 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/f02c4cd2238d4db7a9c4957b1cfac0b3/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:42:52.382091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:52.382798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:52.383073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:52.383400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/f02c4cd2238d4db7a9c4957b1cfac0b3/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:52.388536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, user_id=f02c4cd2238d4db7a9c4957b1cfac0b3, role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:52.390160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901aa61-ed93-4256-a981-310903158e2c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:52.412026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 82/159] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:52 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/f02c4cd2238d4db7a9c4957b1cfac0b3/roles/8580d6ffb0314695b7d97c77052b2597 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:42:54.271199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1f94-4efc-439c-9959-71bba0f11d17 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.271792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1f94-4efc-439c-9959-71bba0f11d17 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.271792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1f94-4efc-439c-9959-71bba0f11d17 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.273541 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 78/160] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:54.279713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9768a0-5df3-4044-bf33-9baf29cc21e3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.280251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9768a0-5df3-4044-bf33-9baf29cc21e3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.280251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9768a0-5df3-4044-bf33-9baf29cc21e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.294893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:54.303055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b9768a0-5df3-4044-bf33-9baf29cc21e3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:54.305071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b9768a0-5df3-4044-bf33-9baf29cc21e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:54.379488 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 83/161] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:54.382674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d68a3-936b-475c-89b4-a9ba476c3a19 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.382961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d68a3-936b-475c-89b4-a9ba476c3a19 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.383238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d68a3-936b-475c-89b4-a9ba476c3a19 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.384587 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 79/162] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:54.389785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49807-4cfa-4361-bbc6-5b224804d2ea None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.390073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49807-4cfa-4361-bbc6-5b224804d2ea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.390343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49807-4cfa-4361-bbc6-5b224804d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.408961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-02a49807-4cfa-4361-bbc6-5b224804d2ea None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:54.410212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-02a49807-4cfa-4361-bbc6-5b224804d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:54.490117 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 84/163] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:54.562797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711c16-200f-4657-a99e-372d9047a29f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.563125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711c16-200f-4657-a99e-372d9047a29f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.563342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56711c16-200f-4657-a99e-372d9047a29f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.564712 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 80/164] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:54.570373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.570660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.570933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.589598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:54.590778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:54.594569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325be6a8-447f-4980-8cd5-20212f7ee3ae None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.595098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325be6a8-447f-4980-8cd5-20212f7ee3ae None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.595583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325be6a8-447f-4980-8cd5-20212f7ee3ae None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.597459 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 81/165] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:54.602548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.602903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.603249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.622965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:54.624283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:54.652666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:54.661410 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 85/166] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:54.662231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:54.704456 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 82/167] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:54.764100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:54.770476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c73d9-9160-4049-8105-09d0ef760eaa None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:54.814281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:54.814921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.815338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.816043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.829341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:54.836377 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:54.837324 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:54.838858 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 86/168] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:54.843335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:54.872987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:54.884476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc207d8-969b-4ee2-bc8d-aa142da0add2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:54.900246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:54.923651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:54.924709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.925221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.926126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.927373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:54.928880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:54.930595 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 83/169] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:54.935536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:54.944664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa85ee-b011-426f-b34b-406ea2184e1b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:54.980077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:54.981030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:54.981310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:54.981574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:54.982246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:54.982548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:54.983956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:54.992372 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 87/170] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:54.993145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.041347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755dd48-92c4-476a-acc1-5b49bc6d8e37 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.076415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.077073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.077348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.077614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.088092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:55.092511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83aab0-6d57-404b-9bc4-75f49b0539eb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:55.093057 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:55.094070 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:55.094848 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 84/171] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:55.095511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.109738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.117534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.128400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.129039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.129312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.129576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.130216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.131671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.152648 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 88/172] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:54 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:42:55.153483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.213097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb02024-1926-452c-a4c7-89f478c27a2b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.251228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.251865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.252135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.252400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.265774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:55.270935 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:55.272412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 85/173] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:55.273255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.279722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070aae-ff56-40c0-b401-e52e862ee983 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.317669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.318476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.318814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.319090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] PATH_INFO: `/v3/users/9a83c292b36e4163a456977995e47c04` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.334604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] RBAC: Authorizing `identity:get_user(user_id=9a83c292b36e4163a456977995e47c04)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.336099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.337984 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 89/174] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/users/9a83c292b36e4163a456977995e47c04 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.338767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.365551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.375445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.391406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0807000-1a47-4048-ba76-0910e39fbf73 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.434893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.435750 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.436176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.436584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.437423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:55.439241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.439241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.449007 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 86/175] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.450224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.459102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c64f3-b630-4be5-a48c-9dd9cec48731 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.499316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.499859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.500132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.500412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.501444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:55.501444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.502827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.511765 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 90/176] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.512675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.578085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715e89f-aafb-4873-a33b-3f5bbea4ec69 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.613330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.613967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.614238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.614499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.615622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.617091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.619154 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 87/177] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.619935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.633396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.643621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.652581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ec46-5261-4194-be2d-eb87d82f1e25 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.687212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.687960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.688291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.688621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] PATH_INFO: `/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.689856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] RBAC: Authorizing `identity:get_user(user_id=f02c4cd2238d4db7a9c4957b1cfac0b3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.691581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.693310 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 91/178] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.694099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.742763 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6b51-d9db-4ecf-aeec-8aab0ac04532 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.781597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.782243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.782524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.782819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] PATH_INFO: `/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.784335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] RBAC: Authorizing `identity:get_user(user_id=f02c4cd2238d4db7a9c4957b1cfac0b3)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.786536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.788696 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 88/179] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/users/f02c4cd2238d4db7a9c4957b1cfac0b3 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:55.793583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.825727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef50a8-3444-41c3-bf6d-6c1b2cf5b095 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:55.861079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:55.862129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:55.862929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:55.863389 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/9a83c292b36e4163a456977995e47c04/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:55.865524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, user_id=9a83c292b36e4163a456977995e47c04, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:55.867275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:55.883780 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 92/180] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:55 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/9a83c292b36e4163a456977995e47c04/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:55.885016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:55.893463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.919812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:55.943136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e6795-5a0d-4cb2-8cbb-1d2446225a12 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.023635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933e2c0-b255-4ab1-8c82-64fe6ce4b396 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.024983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.025614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.025920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.026322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.089347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.090486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.090986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.091451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.183360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.185206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.185313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.188074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.214208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:56.269384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:56.307773 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 89/181] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:56.314407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.332971 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:56.349552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.476661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39faa6-ea8a-4d23-b4d4-1a8f268eca3b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.519238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.519878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.520146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.520403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.521561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.525307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.527157 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 90/183] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:56.538340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.554025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae79e3f-3049-4de8-8616-8f92ad56a4e1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.598546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:56.599612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:56.615939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.617089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.617373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.617647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.618867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.620408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.622637 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 94/184] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:56.632087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:56.671899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47660c-d612-42b4-86e9-56793be7d7a9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.711338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.712327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.712805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.713441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.714668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=e8a1680440ef47e790eaa562ae30e05b, user.id=f02c4cd2238d4db7a9c4957b1cfac0b3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:56.715158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.717204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105d442-27e9-4b38-92c2-c62c436c20b8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.724328 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 91/185] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/role_assignments?user.id=f02c4cd2238d4db7a9c4957b1cfac0b3&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:56.807737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7358d-6e53-4173-84e7-764b0b524cec None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:56.849550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:56.850239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:56.850456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:56.850725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:56.851468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] RBAC: Adding query filter params (role.id=8580d6ffb0314695b7d97c77052b2597, scope.project.id=e8a1680440ef47e790eaa562ae30e05b, user.id=f02c4cd2238d4db7a9c4957b1cfac0b3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:56.851775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:56.853349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca7550-209e-4713-8c9a-f1c1ed66094c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:56.865032 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 95/186] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:56 2022] GET /identity/v3/role_assignments?user.id=f02c4cd2238d4db7a9c4957b1cfac0b3&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=8580d6ffb0314695b7d97c77052b2597 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:57.574438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcbb2-c7f2-4d8f-b137-27fc5478fd5e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:57.575019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcbb2-c7f2-4d8f-b137-27fc5478fd5e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:57.575019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffcbb2-c7f2-4d8f-b137-27fc5478fd5e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:57.576308 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 92/187] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:42:57.581870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:57.582272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:57.582363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:57.590330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9111-a602-4b78-a7f5-a40a55e33c77 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:57.590615 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9111-a602-4b78-a7f5-a40a55e33c77 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:57.590887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba9111-a602-4b78-a7f5-a40a55e33c77 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:57.592206 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 93/188] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:57.597937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:57.598190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:57.598489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:57.601715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:57.602914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:57.620293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:57.621494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:57.661497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:57.679377 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 96/189] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:57.695972 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 94/190] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:42:57.941757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:57.955143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.002938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.043445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da42fe-48a2-408f-b617-8b94a781dfd7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.064171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c11b8-5e2d-449a-82ba-22b7960ae910 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.077902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.078541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.078818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.079082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.095247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:58.100199 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:58.101096 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:58.102145 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 97/191] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:58.103853 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.104498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.104770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.105061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.106543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.106987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.108016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.112884 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 95/192] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:58.115426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.157766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.214536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c85bc1-8b60-428e-b112-ab65a3cc0c7b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.223005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df32b-5ab0-4b59-b89c-69c5bc97e462 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.233330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.250887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.251509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.251746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.252015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.253098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:58.253098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.254481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.261333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.261952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.262234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.262498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.263026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 98/193] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:58.263259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.264860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64adb98-7eca-469e-93ce-98b45e9610cf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.268785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.288688 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 96/194] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:42:58 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:42:58.386974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909977c-0178-4af8-9762-766ed0e39adf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.396116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.396905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ca17-e93e-4d14-9002-0f0b8d94755c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.397192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ca17-e93e-4d14-9002-0f0b8d94755c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.397465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ca17-e93e-4d14-9002-0f0b8d94755c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.398843 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 97/195] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:42:58.404533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.404811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.405130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.424463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:42:58.425734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:42:58.426780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.427431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.427706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.427976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] PATH_INFO: `/v3/users/c9d2b067707f403bb2ff3ee500b47064` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.442752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d2b067707f403bb2ff3ee500b47064)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.444269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.446242 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 99/196] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:58 2022] GET /identity/v3/users/c9d2b067707f403bb2ff3ee500b47064 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:58.451852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.500395 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 98/197] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:42:58.570190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e9924-3e16-4d06-b6a0-96f8cd4318d2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.604978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.605605 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.605885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.606155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.607292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.608763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.610654 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 100/198] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:58 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:58.616769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.713815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.721309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966663a-9747-45d6-9bb4-d30985419a42 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.757073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.757660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.757936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.758209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/c9d2b067707f403bb2ff3ee500b47064/roles/0a5185fedde04b5c9f8dc3c796e17281` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.760226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, user_id=c9d2b067707f403bb2ff3ee500b47064, role_id=0a5185fedde04b5c9f8dc3c796e17281)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:58.761788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:58.777730 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 99/199] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:42:58 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/users/c9d2b067707f403bb2ff3ee500b47064/roles/0a5185fedde04b5c9f8dc3c796e17281 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:42:58.793436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:58.828929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:58.907767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708652b4-c03e-4f5c-a975-55b43485432e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:58.945291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:58.945946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:58.946215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:58.946477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:58.959892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:42:58.965185 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:42:58.966082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:42:58.967269 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 101/200] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:42:58.972290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.078779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544be9-5a4b-406b-8b8e-0234497dbe3b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.114887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.115505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.115774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.116033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.116693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:59.117017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.118388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.127405 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 100/201] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:42:59.133187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.241928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:59.250736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5056b-4d84-496f-9a03-95a313277a88 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.284521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.285447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.285715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.285986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] PATH_INFO: `/v3/users/9a83c292b36e4163a456977995e47c04` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.287162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] RBAC: Authorizing `identity:get_user(user_id=9a83c292b36e4163a456977995e47c04)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.288629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.290251 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 102/202] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/users/9a83c292b36e4163a456977995e47c04 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:59.295900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.315370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:59.406807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfcc20-20d6-4688-9e89-6eb0505a8ad4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.440353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.440984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.441260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.441523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.507888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.509369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.525867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:59.608277 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 101/203] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:42:59.614343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.713868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8138a9-6486-4b08-9118-36716fc309b4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.748687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.749417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.749696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.749966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.751161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.752859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eff263-b7cb-4cdf-b399-e082f7649009 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.754959 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 103/204] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:42:59.760748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:42:59.859040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46db71d-c450-4f92-a9f4-6dc4ea89df65 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:42:59.875493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:42:59.893647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:42:59.894252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:42:59.894520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:42:59.894786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:42:59.895500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] RBAC: Adding query filter params (role.id=7b0ec29716c44100940a0056ee094bab, scope.project.id=e8a1680440ef47e790eaa562ae30e05b, user.id=9a83c292b36e4163a456977995e47c04) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:42:59.895795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:42:59.897277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760204ea-8c86-4b2b-81b4-a476f6b484a3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:42:59.903190 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 102/205] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:42:59 2022] GET /identity/v3/role_assignments?user.id=9a83c292b36e4163a456977995e47c04&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=7b0ec29716c44100940a0056ee094bab => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:00.660645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b7e59-662a-46f2-a877-9038a37c9758 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:00.661196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b7e59-662a-46f2-a877-9038a37c9758 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:00.661196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b7e59-662a-46f2-a877-9038a37c9758 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:00.662040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4071d-e331-444f-a8ae-96a0dde699d6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:00.662320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4071d-e331-444f-a8ae-96a0dde699d6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:00.662711 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 104/206] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:00.662810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4071d-e331-444f-a8ae-96a0dde699d6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:00.663908 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 103/207] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:00.667531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:00.668061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:00.668337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:00.668876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:00.669189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:00.669422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:00.688155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:00.689033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:00.689770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:00.690198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:00.715183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:00.761244 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 105/208] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:00.762108 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 104/209] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:01.024407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.026233 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.124635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affe8f0-cf6a-44fb-992e-b3fb9e72350e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.129764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e321692-e55f-46d1-a76e-04033f4eeb18 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.140217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.159924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.160550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.160823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.161118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.163095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.163723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.163995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.164260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.165392 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.166849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a5ef0-c001-4b3e-a3d6-b1b952b17907 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.168431 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 105/210] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:01.172811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001efb-20f0-4cd5-a04f-4a80b0475e2c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.172811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001efb-20f0-4cd5-a04f-4a80b0475e2c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.172811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c001efb-20f0-4cd5-a04f-4a80b0475e2c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.172811 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 106/211] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:01.173826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c001efb-20f0-4cd5-a04f-4a80b0475e2c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.175997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-613ffb5a-0b3c-4941-93de-7a3501ef6f42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:01.180864 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:01.181975 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:01.182951 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:01.185139 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 106/212] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:01.186256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.186620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.186892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.207689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:01.208964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:01.223096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.285142 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 107/213] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:01.285142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.285378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c001efb-20f0-4cd5-a04f-4a80b0475e2c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.319784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.320386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.320661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.320955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.321600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.323040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.345623 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 107/214] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:01 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:01.393570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d28c4-985f-4bc7-b674-3f25f0d1e488 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.431088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.431777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.432048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.432306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.433010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:01.433305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.434725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.444218 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 108/215] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:01.449990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.487077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.543961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.558669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.566675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67746957-d7f6-4898-9a88-9ee38894cf63 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.604129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.604777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.605084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.605356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] PATH_INFO: `/v3/users/862f0769027741e78695fd576c86b282` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.624089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=862f0769027741e78695fd576c86b282)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.625957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.628479 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 108/216] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/users/862f0769027741e78695fd576c86b282 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:01.634099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.667971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f113c2-bb37-4d6d-a704-79330a881308 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.706012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.706634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.706912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.707179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.722586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:01.729925 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:01.730825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:01.731623 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:01.732283 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 109/217] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:01.740147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:01.742403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.750439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8359caf-7643-4eda-b70c-c60c26cee2f5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.786751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.788095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.788513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.788989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.789861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] RBAC: Adding query filter params (role.id=7b0ec29716c44100940a0056ee094bab, user.id=862f0769027741e78695fd576c86b282, scope.system=all) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:01.790335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.791934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.797547 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 109/218] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/role_assignments?user.id=862f0769027741e78695fd576c86b282&scope.system=all&role.id=7b0ec29716c44100940a0056ee094bab => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:01.821209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:01.853764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1af6-06aa-4ccf-afe4-e26f49bb66b2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:01.896088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:01.896713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:01.897033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:01.897300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:01.897983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:01.898289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:01.899726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:01.909759 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 110/219] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:01.915657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.023670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32574855-7bc9-4c85-b1ca-25ea3b059390 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.060674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.061257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.061534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.061804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] PATH_INFO: `/v3/users/c9d2b067707f403bb2ff3ee500b47064` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.062941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d2b067707f403bb2ff3ee500b47064)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.064396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.066234 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 110/220] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:01 2022] GET /identity/v3/users/c9d2b067707f403bb2ff3ee500b47064 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:02.071861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.174421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f5b92-1927-4b7f-970f-16f60be5ba0d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.208826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.220689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.221364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.221642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.221912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.293490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.294980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.392586 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 111/221] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:02.398469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.425264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.507950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55e98-949b-4021-9f99-1ff5b3f15107 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.542956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.543827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.544244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.544652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.545945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.547584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348fc8b-9c59-4b55-92d9-9a36e40d5c28 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.554416 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 111/222] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:02.557949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:02.587968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:02.655575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394689-fcaf-4785-ad60-1dc3b863a4ad None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:02.689021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:02.689688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:02.689968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:02.690233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:02.690951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] RBAC: Adding query filter params (role.id=0a5185fedde04b5c9f8dc3c796e17281, scope.project.id=e8a1680440ef47e790eaa562ae30e05b, user.id=c9d2b067707f403bb2ff3ee500b47064) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:02.691285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:02.692705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed155ef-46fb-4d2c-af52-5dca20d16b86 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:02.698988 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 112/223] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:02 2022] GET /identity/v3/role_assignments?user.id=c9d2b067707f403bb2ff3ee500b47064&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=0a5185fedde04b5c9f8dc3c796e17281 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:03.704878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89337-cf74-4a55-b409-8955932e8866 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:03.705554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89337-cf74-4a55-b409-8955932e8866 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:03.705554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89337-cf74-4a55-b409-8955932e8866 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:03.707038 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 112/224] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:03.712323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2619-7275-4829-a56a-a8bd2fceb727 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:03.712753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2619-7275-4829-a56a-a8bd2fceb727 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:03.712870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2619-7275-4829-a56a-a8bd2fceb727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:03.719181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1e95-3812-4f2b-8fb6-0b1b67f44f5b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:03.719690 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1e95-3812-4f2b-8fb6-0b1b67f44f5b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:03.719982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1e95-3812-4f2b-8fb6-0b1b67f44f5b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:03.721605 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 113/225] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:03.727201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1600-1138-4d6d-a7a3-5af7bb3b6cfb None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:03.727547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1600-1138-4d6d-a7a3-5af7bb3b6cfb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:03.727745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d1600-1138-4d6d-a7a3-5af7bb3b6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:03.733183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a6c2619-7275-4829-a56a-a8bd2fceb727 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:03.734345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a6c2619-7275-4829-a56a-a8bd2fceb727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:03.746667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-975d1600-1138-4d6d-a7a3-5af7bb3b6cfb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:03.747826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-975d1600-1138-4d6d-a7a3-5af7bb3b6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:03.809578 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 113/226] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:03.817092 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 114/227] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:04.000021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01732e21-26b4-44ce-ad24-451623cba6a3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.000200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01732e21-26b4-44ce-ad24-451623cba6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.000469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01732e21-26b4-44ce-ad24-451623cba6a3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.001905 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 114/228] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:04.007596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.007880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.008147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.027045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:04.028240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:04.045673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.075915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01732e21-26b4-44ce-ad24-451623cba6a3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.100784 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 115/229] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:04.101670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.106562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.184087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01732e21-26b4-44ce-ad24-451623cba6a3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.212340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70a45-6658-4952-b677-26107eb590c4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.219007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.219638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.219905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.220555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.221752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.223568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.225648 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 115/230] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:04.231248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.249303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.249957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.250272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.250479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.260555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:04.265394 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:04.266246 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:04.267034 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 116/231] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:04.272173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.286898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.331223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.338783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bce49-5459-4b44-963d-ea50f17821ba None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.373374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb91d6-9a02-41b5-a09c-f418f555b0b0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.374050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.374666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.374941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.375204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] PATH_INFO: `/v3/groups` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.375845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.377387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.394309 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 116/232] 10.222.0.13 () {60 vars in 1134 bytes} [Sun Oct 16 00:43:04 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:04.395116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.407878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.408559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.408853 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.409128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.409832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:04.410120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.411601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.422410 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 117/233] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:04.428544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.512776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.523925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974a85-ce8d-40a8-abb9-126bcd6a42c7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.542943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c965ec-8ba9-40b7-a8ba-8b29a4c30f36 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.563387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.564044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.564314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.564616 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.577214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:04.581424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.582069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.582352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:04.582604 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:04.583436 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:04.584210 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:04.585271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] PATH_INFO: `/v3/users/2800c77987e4437ab9faa310b13f1a36` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.585366 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 117/234] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:04.589558 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.599658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] RBAC: Authorizing `identity:get_user(user_id=2800c77987e4437ab9faa310b13f1a36)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.601179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.603132 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 118/235] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/users/2800c77987e4437ab9faa310b13f1a36 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:04.609130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.609607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.701790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d204725-6e9e-4422-a9b6-159819c5beb5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.713807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae4a2-5660-4e51-b498-612c4ec5e186 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.742021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.742619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.742892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.743158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.743821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:04.744113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.745569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.749694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.759059 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 118/236] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:04.759218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.759218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.759218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.759218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.759564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] RBAC: Adding query filter params (role.id=0a5185fedde04b5c9f8dc3c796e17281, user.id=2800c77987e4437ab9faa310b13f1a36, scope.system=all) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:04.759564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.759749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.760763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:04.765050 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 119/237] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/role_assignments?user.id=2800c77987e4437ab9faa310b13f1a36&scope.system=all&role.id=0a5185fedde04b5c9f8dc3c796e17281 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:04.847971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:04.874077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce08c4e-7273-4817-a3f6-4a26d631aa5d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:04.911710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:04.912388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:04.912663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:04.912959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] PATH_INFO: `/v3/users/862f0769027741e78695fd576c86b282` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:04.914188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] RBAC: Authorizing `identity:get_user(user_id=862f0769027741e78695fd576c86b282)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:04.915667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e873aa-2bc6-47aa-b1ac-53aa219c7836 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:04.917525 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 119/238] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:04 2022] GET /identity/v3/users/862f0769027741e78695fd576c86b282 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:04.923256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:05.024419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798bd7d-588d-4558-a936-b6a2e6cba5f1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:05.057329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:05.057970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:05.058242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:05.058502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] PATH_INFO: `/v3/system/users/862f0769027741e78695fd576c86b282/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:05.059896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=862f0769027741e78695fd576c86b282, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:05.061330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77f14-4a72-410f-baab-83e54d3f7911 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:05.071416 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 120/239] 10.222.0.13 () {58 vars in 1334 bytes} [Sun Oct 16 00:43:04 2022] PUT /identity/v3/system/users/862f0769027741e78695fd576c86b282/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:06.561799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f78a5-3d29-4e8e-9449-70a601fc45f9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.562340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f78a5-3d29-4e8e-9449-70a601fc45f9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.562340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f78a5-3d29-4e8e-9449-70a601fc45f9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.563666 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 120/240] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:06.569264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34fb2-cc7d-4596-b8ee-235b88ad8922 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.569710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34fb2-cc7d-4596-b8ee-235b88ad8922 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.569957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed34fb2-cc7d-4596-b8ee-235b88ad8922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.588736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0ed34fb2-cc7d-4596-b8ee-235b88ad8922 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:06.589944 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0ed34fb2-cc7d-4596-b8ee-235b88ad8922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:06.648472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:06.661786 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 121/241] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:06.874519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be775f-d300-44fc-8f6a-b6cfd8edcd4a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.874758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be775f-d300-44fc-8f6a-b6cfd8edcd4a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.875185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be775f-d300-44fc-8f6a-b6cfd8edcd4a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.879077 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 121/242] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:06.882215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:06.882479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:06.882764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:06.901539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:06.902743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:06.924618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be775f-d300-44fc-8f6a-b6cfd8edcd4a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:06.976617 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 122/243] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:07.030940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be775f-d300-44fc-8f6a-b6cfd8edcd4a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.066434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.067090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.067360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.067621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.068776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.070290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11791e6e-82b1-403a-9dc5-78eae2cbdafd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.071948 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 122/244] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:07.077904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.180095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988233-4f20-4eae-a12d-4c1585edba2f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.180301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988233-4f20-4eae-a12d-4c1585edba2f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.180567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6988233-4f20-4eae-a12d-4c1585edba2f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.182093 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 123/245] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:07.185464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d64f4-f9d3-4ad9-87bf-0acac9ac5d6a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.186864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.187147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.187411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.205520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:07.206712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:07.207352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.214431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.224566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.225220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.225492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.225752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] PATH_INFO: `/v3/groups` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.226384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.229946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.250133 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 123/246] 10.222.0.13 () {60 vars in 1134 bytes} [Sun Oct 16 00:43:07 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:43:07.250905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.288886 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 124/247] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:07.362093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2404c6-739b-40f5-840f-3f5f6d7e10fd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.400078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.400739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.401045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.401314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.412912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:07.418372 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:07.419276 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:07.420056 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 124/248] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:07.425748 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.528924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d752b1-ac01-40f0-a348-131f7f393b90 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.551538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.575125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.575792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.576015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.576282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.576992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:07.577289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.578696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.589089 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 125/249] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:07.595110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.599682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.608168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.677731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe24b28-4843-4ccd-9ece-a0f7a92cf41e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.722462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.723138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.723537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.723934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.731239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049c60-3055-47a9-9a2a-32bda6535610 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.736924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:07.742694 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:07.743602 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:07.745101 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 125/250] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:07.751079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.773061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.773697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.773960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.774234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] PATH_INFO: `/v3/users/2800c77987e4437ab9faa310b13f1a36` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.775356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] RBAC: Authorizing `identity:get_user(user_id=2800c77987e4437ab9faa310b13f1a36)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.776850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.783355 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 126/251] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/users/2800c77987e4437ab9faa310b13f1a36 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:07.785380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.878305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.879478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:07.886589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdb0fe-afcc-4dac-bb1a-5506cabe49f8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.917466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91253bca-4cad-4cd9-8d62-035b7ec1194e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:07.927880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.929067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.929540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.930001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.931148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:07.931640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.933849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.944152 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 126/252] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:07.949125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:07.958737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:07.959399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:07.959661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:07.959928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] PATH_INFO: `/v3/system/users/2800c77987e4437ab9faa310b13f1a36/roles/0a5185fedde04b5c9f8dc3c796e17281` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:07.961765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2800c77987e4437ab9faa310b13f1a36, role_id=0a5185fedde04b5c9f8dc3c796e17281)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:07.963167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:07.980898 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 127/253] 10.222.0.13 () {58 vars in 1334 bytes} [Sun Oct 16 00:43:07 2022] PUT /identity/v3/system/users/2800c77987e4437ab9faa310b13f1a36/roles/0a5185fedde04b5c9f8dc3c796e17281 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:08.067041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25314167-8b4d-4f57-9f13-49287fc18660 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.104241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.104940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.105194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.105462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] PATH_INFO: `/v3/users/862f0769027741e78695fd576c86b282` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.106626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=862f0769027741e78695fd576c86b282)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.108104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144987d-f39c-414b-b939-3d564585c4a2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.110124 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 127/254] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:07 2022] GET /identity/v3/users/862f0769027741e78695fd576c86b282 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:08.116112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:08.226952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf090d-08a9-4805-acc8-a2b3846bceb3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:08.263726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:08.264360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:08.264632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:08.264922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:08.265676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] RBAC: Adding query filter params (role.id=7b0ec29716c44100940a0056ee094bab, user.id=862f0769027741e78695fd576c86b282, scope.system=all) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:08.265974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:08.267573 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cec7b-4d4e-4b9c-aaf9-208a72e933ab None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:08.270703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:08.291234 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 128/255] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:08 2022] GET /identity/v3/role_assignments?user.id=862f0769027741e78695fd576c86b282&scope.system=all&role.id=7b0ec29716c44100940a0056ee094bab => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:09.611553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d51b5-af95-48b5-9378-16ab730686a8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.612961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d51b5-af95-48b5-9378-16ab730686a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.613438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d51b5-af95-48b5-9378-16ab730686a8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.615261 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 128/256] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:09.620943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7abd-1b58-4249-a6ee-e261d2aa41d2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.621746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7abd-1b58-4249-a6ee-e261d2aa41d2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.622205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae7abd-1b58-4249-a6ee-e261d2aa41d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.643417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-05ae7abd-1b58-4249-a6ee-e261d2aa41d2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:09.645005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05ae7abd-1b58-4249-a6ee-e261d2aa41d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:09.712995 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 16 00:43:09.847950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825be74-0abd-4380-ae1d-3cf08ce95a5c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.848308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825be74-0abd-4380-ae1d-3cf08ce95a5c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.848492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825be74-0abd-4380-ae1d-3cf08ce95a5c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.850040 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 129/258] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:09.855608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:09.855894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:09.856164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:09.881077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:09.882276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:09.895950 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 130/259] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:43:10.199629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825be74-0abd-4380-ae1d-3cf08ce95a5c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.212517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825be74-0abd-4380-ae1d-3cf08ce95a5c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.217969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.218841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.219306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.219765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.233167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:10.238686 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:10.239552 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:10.240343 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:10.242899 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 130/260] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:10.248940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.261225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ff77e-1dd5-44eb-9297-eedfd0933b96 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.266003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.266874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.267388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.267849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.268705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:10.269334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.271331 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.271331 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:43:10.271331 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:43:10.272574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.281512 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 131/261] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:10.287575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.298745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f838-68b8-46a2-be9a-ca0a56d92854 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.303667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.304530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.305050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.305542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.312708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.314865 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.314865 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:43:10.314865 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:43:10.316497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.318699 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 131/262] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:10.324490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.337179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4227c1-5031-4998-96b1-2c5c6f9298d0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.341968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.342852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.343318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.343773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.345233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.347689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.350108 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 132/263] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:10.356067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.367462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2cca55-9497-4c77-b504-deceaa37185f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.372515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.373521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.374006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.374511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.376932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, group_id=52c6af2920a8420c8f452ccbed8e1b7b, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.378242 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.378242 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:43:10.378242 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:43:10.380630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.399658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.400903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:10.412190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f76ba8-6b82-4998-a35a-053c4f13649f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.420618 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 132/264] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 16 00:43:10 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:10.491556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.492595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.493121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.493630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.506547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:10.512582 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:10.513502 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:10.514325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:10.517056 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 133/265] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:10.522967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.537086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29d77-067b-4463-87d4-97fc8c1cd999 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.542291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.543184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.543687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.544185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.545130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:10.545667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.546986 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.546986 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:43:10.546986 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:43:10.548349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.561249 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 133/266] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:10.569262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.580338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff0dd-7f73-4338-a9f8-e9631e21648b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.588316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.589313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.589831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.590349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.591721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.593020 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.593020 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:43:10.593020 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:43:10.594763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.596672 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 134/267] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:10.602588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.614131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecc6ca-77e6-406c-a9ad-8fc368d03e72 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.621979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.623079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.623550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.624065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.625952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.628441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277054b-f29d-4ff1-9a67-8e42141ff342 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.630423 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 134/268] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:43:10 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:10.636407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:10.649091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46b827-031e-4bf1-9d27-5a6dda9ba6e9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:10.654594 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:10.655689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:10.656281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:10.656745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:10.661015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb24a05230945e78568c5993adc8b60, group_id=52c6af2920a8420c8f452ccbed8e1b7b, role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:10.662457 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:43:10.662457 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:43:10.662457 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:43:10.665037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfee305-a6e7-463b-8443-e5acdab15a33 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:10.691528 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 135/269] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 16 00:43:10 2022] PUT /identity/v3/projects/afb24a05230945e78568c5993adc8b60/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/8580d6ffb0314695b7d97c77052b2597 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:11.039662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c25c4-e2b2-4979-90a6-18d23fd51ff9 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.040349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c25c4-e2b2-4979-90a6-18d23fd51ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.040863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c25c4-e2b2-4979-90a6-18d23fd51ff9 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.042428 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 135/270] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:11.047705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f6122-994f-4537-a6f6-53864ee18fbe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.047983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f6122-994f-4537-a6f6-53864ee18fbe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.048251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f6122-994f-4537-a6f6-53864ee18fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.074067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-627f6122-994f-4537-a6f6-53864ee18fbe None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:11.075280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-627f6122-994f-4537-a6f6-53864ee18fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:11.140407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:11.165260 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 136/271] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:43:11.670753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f454-c48f-4fa0-8296-d0f681c4483f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.671802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f454-c48f-4fa0-8296-d0f681c4483f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.672274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1f454-c48f-4fa0-8296-d0f681c4483f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.673986 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 136/272] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:11.695354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.695875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.695985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.704768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1f454-c48f-4fa0-8296-d0f681c4483f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.721700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1f454-c48f-4fa0-8296-d0f681c4483f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.723548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:11.724869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:11.729212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.731032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.731520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.731981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.752867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:11.758810 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:11.759676 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:11.760478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:11.763070 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 137/273] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:43:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:11.769082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.779688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba096fd8-bc59-43d8-afb3-7ff9bc8de7de admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.787293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.787924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.788199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.788469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.789179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:11.789475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.795860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.818123 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 138/274] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:43:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:11.823253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.847160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f016fbe-5f83-4eeb-804e-85468213b500 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.862418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.863086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.863360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.863624 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.865295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.867245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.871424 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 137/275] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:11.871699 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 139/276] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 16 00:43:11 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:11.874411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.886238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776542f3-bd4b-410e-9591-3a6ebe78fc60 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.891793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.892506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.892782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.893087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.894227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.896345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2168c9a-17ac-459c-88da-df928d8247b8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.898039 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 138/277] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:43:11 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:11.903941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:11.916194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9fbc8-0ecb-4490-9747-dc7af0cb89ed admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:11.920722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:11.921531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.921754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.922028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.924001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, group_id=52c6af2920a8420c8f452ccbed8e1b7b, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:11.926749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed7b4d-d057-4d4e-b987-1b91fd81eb52 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:11.951584 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 140/278] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 16 00:43:11 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:11.973534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e89f3-375c-4aa3-89da-7c3feaf8b619 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.973891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e89f3-375c-4aa3-89da-7c3feaf8b619 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.974089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e89f3-375c-4aa3-89da-7c3feaf8b619 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:11.975897 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 139/279] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:11.982053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:11.982644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:11.983143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.014452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:12.016048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:12.102409 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 141/280] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 16 00:43:12.217185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e89f3-375c-4aa3-89da-7c3feaf8b619 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.353593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e89f3-375c-4aa3-89da-7c3feaf8b619 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.372049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:12.401703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.402367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.402635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.402902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.414504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:12.419669 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:12.420660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 16 00:43:12.421500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:12.422618 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 140/281] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:12.428267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.483784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.507012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf91f8-daea-48c7-aeca-749fc00e4b56 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.519068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.519712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.520004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.520265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.543726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:12.548901 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:12.549762 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:12.550573 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 141/282] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:12.555749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:12.557443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.565098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08e011-8c09-40e4-ab87-5c0afdd7fc63 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.571581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6a04-7c4b-40e8-b8d3-c272dab6a94a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.585182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.585808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.586083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.586356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.587033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:12.587328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.589123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4292-174d-43bd-bc12-3cbe2e480715 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.603816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.604673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.605089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.605452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.606527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:12.606923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.608326 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 142/283] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:12.608629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af77a9b-216d-40f6-9917-ec920bc1ff14 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.609635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761aba-80f3-4e84-98a0-b266733adf14 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.609912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761aba-80f3-4e84-98a0-b266733adf14 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.610302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761aba-80f3-4e84-98a0-b266733adf14 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.611732 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 143/284] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:12.617664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761aba-80f3-4e84-98a0-b266733adf14 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.620865 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 142/285] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:12.626097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.626421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.626695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.633526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761aba-80f3-4e84-98a0-b266733adf14 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.638637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.639361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.639687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.639961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.641140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.643426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.645510 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 144/286] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:12.646449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.670132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:12.671262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:12.698507 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 143/287] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 16 00:43:12.699378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.708859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f986e-a34a-41e6-a749-6702101669a8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.733251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.733970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.734187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.734458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.735591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.741905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.743586 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 144/288] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:12.750300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.764538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e995ab-a03b-4aa3-96fe-99599e7d7fa3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.773596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba51d6-fdaa-45c2-a48c-d5ad8be2592d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.778387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.779063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.779336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.779602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.781770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1680440ef47e790eaa562ae30e05b, group_id=52c6af2920a8420c8f452ccbed8e1b7b, role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.784503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.819680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.820349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.820532 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 145/289] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 16 00:43:12 2022] PUT /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b/groups/52c6af2920a8420c8f452ccbed8e1b7b/roles/8580d6ffb0314695b7d97c77052b2597 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:12.821026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.821303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] PATH_INFO: `/v3/users/2800c77987e4437ab9faa310b13f1a36` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.822510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=2800c77987e4437ab9faa310b13f1a36)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.824169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:12.826332 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 145/290] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/users/2800c77987e4437ab9faa310b13f1a36 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:12.832162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:12.948185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f69feb-89a3-443f-b36f-2d61c194c8ef admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:12.979748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:12.990696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:12.991255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:12.991633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:12.991901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:12.993104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] RBAC: Adding query filter params (role.id=0a5185fedde04b5c9f8dc3c796e17281, user.id=2800c77987e4437ab9faa310b13f1a36, scope.system=all) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:12.993285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:12.994823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:13.011936 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 146/291] 10.222.0.13 () {56 vars in 1308 bytes} [Sun Oct 16 00:43:12 2022] GET /identity/v3/role_assignments?user.id=2800c77987e4437ab9faa310b13f1a36&scope.system=all&role.id=0a5185fedde04b5c9f8dc3c796e17281 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:13.271410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:13.302109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:13.352818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87db2f-f21a-443e-9ec1-93123bd92eb3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:13.357540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:13.358187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:13.358462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:13.358737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:13.370575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:13.375443 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:13.376284 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:13.377183 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:13.378267 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 146/292] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:13.382504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:13.398458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7b507-647c-4e4e-9579-c5a2cc960abc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:13.403066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:13.403691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:13.403967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:13.404236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:13.404934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:13.405239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:13.406862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:13.419470 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 147/293] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:13.425205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:13.436051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6def-9b7a-41e9-b7bd-fdfd14708811 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:13.440704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:13.441372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:13.441647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:13.441916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] PATH_INFO: `/v3/groups/ad18785f152940c49c905d6d80355e94` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:13.453538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] RBAC: Authorizing `identity:get_group(group_id=ad18785f152940c49c905d6d80355e94)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:13.455602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:13.457672 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 147/294] 10.222.0.13 () {56 vars in 1201 bytes} [Sun Oct 16 00:43:13 2022] GET /identity/v3/groups/ad18785f152940c49c905d6d80355e94 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:13.463645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:13.478404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bdb04-8268-42c5-96e9-fecfc3f47e34 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:13.489433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:13.490075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:13.490348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:13.490612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] PATH_INFO: `/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:13.497566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] RBAC: Authorizing `identity:get_project(project_id=76fd6f2e827447f4be188ab2a5fb6b88)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:13.499386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134eed6-b697-49c9-9d95-51822e2e17cc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:13.501272 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 148/295] 10.222.0.13 () {56 vars in 1207 bytes} [Sun Oct 16 00:43:13 2022] GET /identity/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88 => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:13.507425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:13.522572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c23d-4292-49b4-b05e-915496e3ef6a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:13.532602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:13.533311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:13.533587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:13.533853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] PATH_INFO: `/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88/groups/ad18785f152940c49c905d6d80355e94/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:13.538168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fd6f2e827447f4be188ab2a5fb6b88, group_id=ad18785f152940c49c905d6d80355e94, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:13.540887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9989-1b85-4c70-bda7-7416e36d7d6d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:13.570631 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 148/296] 10.222.0.13 () {58 vars in 1463 bytes} [Sun Oct 16 00:43:13 2022] PUT /identity/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88/groups/ad18785f152940c49c905d6d80355e94/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:14.094677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6335b-3c1b-47ec-9186-dcf9dd9e5ddd None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.095387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6335b-3c1b-47ec-9186-dcf9dd9e5ddd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.095387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6335b-3c1b-47ec-9186-dcf9dd9e5ddd None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.096977 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 149/297] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:14.102810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.103342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.103342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.125571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:14.127349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:14.153140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2144f-a63f-470c-ac4c-bf15b92bdacb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.153478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2144f-a63f-470c-ac4c-bf15b92bdacb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.153692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2144f-a63f-470c-ac4c-bf15b92bdacb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.156686 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 150/298] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:14.161110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.161377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.161644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.197868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:14.199076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:14.203496 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 149/299] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:14.303001 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 151/300] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:14.790426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:14.802031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:14.873311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:14.914249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b898a4-0855-496b-9580-3afca58fbed6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:14.954889 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:14.956046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:14.956510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:14.957024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:14.965904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c246e-61b5-4764-9a40-83fc993cbbda None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:14.969910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:14.973893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:14.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:14.980496 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:14.981315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:14.982847 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 150/301] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:14.989881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.024296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.024961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.025252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.025518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.040575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:15.045380 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:15.046233 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:15.047015 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 152/302] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:15.054263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.106587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a040c79-5c54-43a2-9809-8bd7cfd9409a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.136282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.147568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.148567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.149091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.149574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.150457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:15.151013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.152648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.163160 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 151/303] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:15.172261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.261605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398448c1-57ba-4850-9b06-9c0ac207c59f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.290105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e947b-b195-4c4f-88f6-008dab8c1de2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.322654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.323204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.323741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.324015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.324694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:15.325051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.326685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bab43d-ddf0-4c0a-a09c-fc14e96caee7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.331408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.332366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.332828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.333311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.340420 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 153/304] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:15.341798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0a16-76c9-4730-a979-3be7a97a1d49 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.342082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0a16-76c9-4730-a979-3be7a97a1d49 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.342355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0a16-76c9-4730-a979-3be7a97a1d49 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.345465 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 154/305] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:15.350046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.350484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.350730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.378216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:15.379428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:15.410870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.417108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.425204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.427274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.466858 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 155/306] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:15.467727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.545091 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 152/307] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:43:15.546348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.646431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.656518 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0e04b-f2af-4ef2-af97-41c4e25fbd60 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.679028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7f087-7f60-4d67-b7f5-0a9ae7b4f1e7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.692951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.693592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.693873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.694140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.695284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.696768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.703133 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 153/308] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:15.704516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.741514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.742132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.742407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.742670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.774376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.814659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a5d23-4c1f-4d9f-a6e0-4cc9f8e24b68 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:15.820553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.822177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a72a9a-dfdc-42af-a987-ebaa81950ea4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.856945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:15.857901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.858174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.858703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.859834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:15.862692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e50c5d-3b54-45a4-842a-5818dc5728ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:15.868923 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 154/309] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:15.872491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0980-7dc4-4eb8-ae2a-d300e0c6fb98 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.872765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0980-7dc4-4eb8-ae2a-d300e0c6fb98 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.874291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0980-7dc4-4eb8-ae2a-d300e0c6fb98 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.875757 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 155/310] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:15.876362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0980-7dc4-4eb8-ae2a-d300e0c6fb98 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:15.911565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:15.955074 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 156/311] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:15.960216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:15.960503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:15.960772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:15.980014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:15.981575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:16.008634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0980-7dc4-4eb8-ae2a-d300e0c6fb98 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.047425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.048454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.048728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.049025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.049752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] RBAC: Adding query filter params (group.id=52c6af2920a8420c8f452ccbed8e1b7b, role.id=7b0ec29716c44100940a0056ee094bab, scope.project.id=afb24a05230945e78568c5993adc8b60) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:16.050084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.050362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.052755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.063422 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 156/312] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 16 00:43:15 2022] GET /identity/v3/role_assignments?group.id=52c6af2920a8420c8f452ccbed8e1b7b&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=7b0ec29716c44100940a0056ee094bab => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:16.064121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.068515 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 157/313] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:16.069501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.184245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.200972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff2dde-e87d-46b9-b1d0-dfcebedbba36 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.203830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55977daf-e954-45ec-ba7a-00a8134b78b1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.244000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.244996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.245494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.246016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] PATH_INFO: `/v3/projects/afb24a05230945e78568c5993adc8b60` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.247456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] RBAC: Authorizing `identity:get_project(project_id=afb24a05230945e78568c5993adc8b60)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.250685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.250685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.250685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.250685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.251660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.253938 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 158/314] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/projects/afb24a05230945e78568c5993adc8b60 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:16.262307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.269390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:16.275709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:16.276673 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:16.277553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 157/315] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:16.288488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.342688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.411217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038817c-fd28-488e-b740-5c25507de729 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.431408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2b4b-5b70-41b8-a544-d80e83d18bdd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.464573 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.465608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.466270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.466829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.469296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.471971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.474710 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 159/316] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:16.480525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.483493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.484115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.484392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.484662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.485365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:16.485728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.488663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984344c-97cd-4770-a8b7-2d6f116b00a4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.501461 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 158/317] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:16.502798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530223-3ae8-4d9f-945b-786816563aee None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.503079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530223-3ae8-4d9f-945b-786816563aee None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.503540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64530223-3ae8-4d9f-945b-786816563aee None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.505333 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 159/318] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:16.507011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530223-3ae8-4d9f-945b-786816563aee None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.526029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.600792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734274af-442a-43e8-8c69-df4b3e7439e2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.627760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64530223-3ae8-4d9f-945b-786816563aee None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.627941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.640225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.640865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.641138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.641399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.642252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] RBAC: Adding query filter params (group.id=52c6af2920a8420c8f452ccbed8e1b7b, role.id=8580d6ffb0314695b7d97c77052b2597, scope.project.id=afb24a05230945e78568c5993adc8b60) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:16.642550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.643995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8b972-3541-4dc1-bca6-9513bf561a17 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.649843 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 160/319] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/role_assignments?group.id=52c6af2920a8420c8f452ccbed8e1b7b&scope.project.id=afb24a05230945e78568c5993adc8b60&role.id=8580d6ffb0314695b7d97c77052b2597 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:16.651022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.651299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.651657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.666697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.667418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.667769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.668098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.674412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:16.675722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:16.758107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:16.759783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:16.766606 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 161/320] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:16.767808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.780771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.893414 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 160/321] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:43:16.898995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:16.906136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3273e84-7d84-40d4-ba7d-23e5f969917f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:16.926123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:16.950808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:16.951788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:16.952275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:16.952744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:16.966885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:16.973977 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:16.975637 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:16.978417 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 162/322] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:16.984935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.029204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c886d4-b0be-490f-a062-bb205d17a8ea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.042970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.064695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.065357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.065628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.065890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.067038 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.068529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.070370 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 161/323] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:17.075703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.120052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb44c-f1b5-4ec9-8b54-d83d1d85b70f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.161423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.162040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.162313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.162582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.163251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:17.163551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.165159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.174527 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 163/324] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:17.175445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.192548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8121baa-cf4c-48d6-a36f-68a0771e9bdc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.220702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.232489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.233164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.233438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.233703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.234874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.236442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.238788 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 162/325] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:17.239583 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.295429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea474-646d-4500-802a-80e20100bcb4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.303388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.338578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.339226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.339503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.339765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.350438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:17.356410 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:17.357480 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:17.358292 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 164/326] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:17.358937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.360010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e44940-edf6-49ed-86ff-491b72cd2001 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.403893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.404910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.405040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.405390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.474074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.477837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8bf24-5714-477b-9570-7b74616d656e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.487318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.488986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.518478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.519092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.519366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.519637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.520372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] RBAC: Adding query filter params (group.id=52c6af2920a8420c8f452ccbed8e1b7b, role.id=7b0ec29716c44100940a0056ee094bab, scope.project.id=e8a1680440ef47e790eaa562ae30e05b) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:17.520810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.522148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.530042 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 165/327] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/role_assignments?group.id=52c6af2920a8420c8f452ccbed8e1b7b&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=7b0ec29716c44100940a0056ee094bab => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:17.530757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.548562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.620356 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 163/328] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:17.626334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.666897 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfaec2-9b7f-472f-aeaf-b23ec54a189a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.708519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.709175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.709463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.709712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.710370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:17.710662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.712055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.723034 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 166/329] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:17.728974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.732797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7137aab-43ed-46f9-958f-b7314ae94c97 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.763766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.769871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.770577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.770877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.771152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] PATH_INFO: `/v3/projects/e8a1680440ef47e790eaa562ae30e05b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.773344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] RBAC: Authorizing `identity:get_project(project_id=e8a1680440ef47e790eaa562ae30e05b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.774823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.777109 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 164/330] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/projects/e8a1680440ef47e790eaa562ae30e05b => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:17.782898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.805900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:17.847410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d132-ae41-4a67-b5a8-2715ed016b0a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.886805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.887657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.887920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.888186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.900951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d904a8-58ad-4709-9550-a6d15a28ec1b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:17.938449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:17.939113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:17.939387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:17.939658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] PATH_INFO: `/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:17.940754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] RBAC: Authorizing `identity:get_group(group_id=52c6af2920a8420c8f452ccbed8e1b7b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.942241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.943825 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 165/331] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/groups/52c6af2920a8420c8f452ccbed8e1b7b => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:17.949619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:17.959682 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:17.961176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:17.986532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:18.032464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:18.048857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839036-1477-431a-b42f-63d9627a65e7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:18.059266 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 167/332] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 16 00:43:18.065219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:18.084055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:18.084055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:18.084055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:18.084055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:18.085009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] RBAC: Adding query filter params (group.id=52c6af2920a8420c8f452ccbed8e1b7b, role.id=8580d6ffb0314695b7d97c77052b2597, scope.project.id=e8a1680440ef47e790eaa562ae30e05b) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:18.085009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:18.085581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:18.091721 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 166/333] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 16 00:43:17 2022] GET /identity/v3/role_assignments?group.id=52c6af2920a8420c8f452ccbed8e1b7b&scope.project.id=e8a1680440ef47e790eaa562ae30e05b&role.id=8580d6ffb0314695b7d97c77052b2597 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:18.178576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb789d-9898-45da-9225-3a9c8e170ab9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:18.206875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:18.216656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:18.217332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:18.217626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:18.217893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] PATH_INFO: `/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:18.219128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] RBAC: Authorizing `identity:get_project(project_id=76fd6f2e827447f4be188ab2a5fb6b88)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:18.220701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:18.222443 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 168/334] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:43:18 2022] GET /identity/v3/projects/76fd6f2e827447f4be188ab2a5fb6b88 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:18.228482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:18.330729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99de6-e754-46be-b440-d7ae77bcdd08 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:18.364926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:18.365508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:18.365779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:18.366054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] PATH_INFO: `/v3/groups/ad18785f152940c49c905d6d80355e94` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:18.367159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] RBAC: Authorizing `identity:get_group(group_id=ad18785f152940c49c905d6d80355e94)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:18.368618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d05a1-8206-448b-bc2d-d50ccde58ede None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:18.370247 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 167/335] 10.222.0.13 () {56 vars in 1180 bytes} [Sun Oct 16 00:43:18 2022] GET /identity/v3/groups/ad18785f152940c49c905d6d80355e94 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:18.376633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:18.480027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2496b-4f6e-435e-ae4f-e0336d2635d7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:18.513284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:18.513879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:18.514148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:18.514412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:18.515121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] RBAC: Adding query filter params (group.id=ad18785f152940c49c905d6d80355e94, role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=76fd6f2e827447f4be188ab2a5fb6b88) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:18.515417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:18.516881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82011541-4d9b-4593-ad9b-8714f3c86e6d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:18.522529 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 169/336] 10.222.0.13 () {56 vars in 1376 bytes} [Sun Oct 16 00:43:18 2022] GET /identity/v3/role_assignments?group.id=ad18785f152940c49c905d6d80355e94&scope.project.id=76fd6f2e827447f4be188ab2a5fb6b88&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:21.032441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90e7b-512d-43fa-951d-e8dfbfa2756b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.033028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90e7b-512d-43fa-951d-e8dfbfa2756b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.033028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90e7b-512d-43fa-951d-e8dfbfa2756b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.034691 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 168/337] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:21.039697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb282-5ca4-4c0f-ad92-ddf361a7e207 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.040096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb282-5ca4-4c0f-ad92-ddf361a7e207 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.040294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bb282-5ca4-4c0f-ad92-ddf361a7e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.059976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a42bb282-5ca4-4c0f-ad92-ddf361a7e207 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:21.061533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a42bb282-5ca4-4c0f-ad92-ddf361a7e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:21.144699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.166506 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:21.265682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bcae-6b12-4c41-8ceb-d35d1feb57b8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.266007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bcae-6b12-4c41-8ceb-d35d1feb57b8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.266231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766bcae-6b12-4c41-8ceb-d35d1feb57b8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.267661 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 169/339] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:21.273088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.273367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.273637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.311411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:21.312570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:21.408523 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:21.578023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766bcae-6b12-4c41-8ceb-d35d1feb57b8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.600565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.717533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766bcae-6b12-4c41-8ceb-d35d1feb57b8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.755724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.765771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.766861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.767332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.767791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.783896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.786486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-14156153-897c-4ff0-a053-41199ea71b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:21.809676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:21.810672 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:21.811508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:21.811508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:21.811508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:21.813668 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 170/341] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:21.819842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff50db-e260-4097-ac2f-e767f127af56 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.820462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff50db-e260-4097-ac2f-e767f127af56 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.820974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff50db-e260-4097-ac2f-e767f127af56 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.822799 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 171/342] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:21.823732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff50db-e260-4097-ac2f-e767f127af56 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:21.880600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f434-9a58-461e-af0f-8621c7fe6e65 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.897308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.897746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:21.916152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.916782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.917090 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.917349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.928456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.929927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.933348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff50db-e260-4097-ac2f-e767f127af56 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a65f04b6-77bf-4358-8393-65c9fc5fa37f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:21.947078 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:21.948272 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:21.949329 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:21.949329 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:21.949329 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:21.949329 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 172/343] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:21.949553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0ed6-4b94-45a3-8c50-6cd318d8f02e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.949698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0ed6-4b94-45a3-8c50-6cd318d8f02e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.949963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb0ed6-4b94-45a3-8c50-6cd318d8f02e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.951331 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 173/344] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:21.956285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147173d1-b6bf-42e5-9b48-f7508be0bc4b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.956536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147173d1-b6bf-42e5-9b48-f7508be0bc4b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.956802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147173d1-b6bf-42e5-9b48-f7508be0bc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.974687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:21.974952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-147173d1-b6bf-42e5-9b48-f7508be0bc4b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:21.975298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:21.975568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:21.975833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:21.976087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-147173d1-b6bf-42e5-9b48-f7508be0bc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:21.976460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:21.976752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:21.978149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:21.989962 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 172/345] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:21.994667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.051513 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 174/346] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:22.052920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.053193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.053453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.072685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:22.073887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:22.112326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad11f-0316-4a69-87c3-3983618505af None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.143486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.155220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.156139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.156609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.157076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.158127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:22.158588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.160220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.164167 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 175/347] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:22.170415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.175145 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 173/348] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:22.187372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.215547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.323914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa701ae-0fa4-430f-8f06-ca0bf7d26cdf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.376191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.376938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.377146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.377418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.378081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.378207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ba259-228f-4622-bc12-adaa1f9837cf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.379761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.407292 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 176/349] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/users => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:22.409209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.433093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.434039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.434456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.434875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.435693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.437552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.478524 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 174/350] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/users => generated 248 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:22.509977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.610660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.618778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.657705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b74c-b488-401f-9789-21f6658855ed None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.695461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e911711-3c21-41b5-b397-d06dd75dd1fa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.708185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.709020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.709477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.709827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.723438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.725376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-903d8310-c196-409e-91f2-205c0cfb895c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:22.742010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:22.743362 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 177/351] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70ff1-cc5b-4594-88bc-eeda0dd256d6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.745033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70ff1-cc5b-4594-88bc-eeda0dd256d6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.746311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d70ff1-cc5b-4594-88bc-eeda0dd256d6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.747524 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 178/352] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:22.749692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d70ff1-cc5b-4594-88bc-eeda0dd256d6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.749984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.750642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.751206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.751518 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.765724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.767901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7202c8a6-f67c-45a5-89f7-fa8b6c6de461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:22.783608 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:22.784542 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:22.785489 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:22.785489 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:22.785489 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:22.792515 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 175/353] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:22.792515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.792515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.792515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.815682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:22.816981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:22.882076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d70ff1-cc5b-4594-88bc-eeda0dd256d6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:22.908346 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 176/354] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:22.909709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.932878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:22.932878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:22.933203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:22.933478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:22.934160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:22.934450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:22.937958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:22.950756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:22.963396 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 179/355] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:22.969024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:22.975383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.088204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439fb7-1cfe-461d-a621-9feeb89ffa3c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.124552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd2942-f15e-4ac8-b994-53ff8a00fd20 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.159282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.159809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.160109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.160332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.161084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:23.161378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.162761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.163552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.164353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.164778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.165217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.166082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.167645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.174456 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 177/356] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:23.176519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.199030 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 180/357] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:22 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:23.199847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.266338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.322521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae73f4-cd5d-4fd9-9ef6-64f58c93234a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.362143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.362769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.363041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.363311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.363962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.365461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.370767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.397207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090c72d-6b39-4429-8756-7cd3626e3903 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.417370 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 181/358] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:23 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:23.450580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.451213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.451530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.451754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.452438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.453966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.465482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.sql.core [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:43:23.465482 dv-cinder-master-3-smb devstack@keystone.service[81466]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:43:23.465482 dv-cinder-master-3-smb devstack@keystone.service[81466]: [parameters: {'id': 'e48aa77987cc4a70adf18402d0376412', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:43:23.465482 dv-cinder-master-3-smb devstack@keystone.service[81466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Oct 16 00:43:23.483092 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return ref.to_dict() Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:43:23.484054 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application yield resource Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise self.value Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application session.commit() Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:43:23.485156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:43:23.486009 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:43:23.488799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application result.read() Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:43:23.493881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [parameters: {'id': 'e48aa77987cc4a70adf18402d0376412', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:23.495510 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 16 00:43:23.497600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:23.499692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 178/359] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 16 00:43:23 2022] POST /identity/v3/roles => generated 144 bytes in 309 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:23.499848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.617862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d898f-9a79-441f-9de5-6f3eaf678f59 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.630115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:23.658811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.659457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.659735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.660000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.670747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cce18400-72ec-487c-b2da-4f719984b0af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:23.676879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:23.678939 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:23.681095 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 182/360] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:23.687411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:23.796139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7934e-ad60-4eb7-9948-1a122d95cc03 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:23.834436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:23.835056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:23.835331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:23.835600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:23.836261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:23.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:23.838065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb328ae-1865-425c-b643-b7fa77c626d6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:23.846862 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 179/361] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:24.970658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bee8d-cbe8-4860-9769-de3d0d375f33 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:24.971219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bee8d-cbe8-4860-9769-de3d0d375f33 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:24.971219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bee8d-cbe8-4860-9769-de3d0d375f33 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:24.972534 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 183/362] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:24.978171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34261-9c45-4c08-a995-46f2b7707da5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:24.978610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34261-9c45-4c08-a995-46f2b7707da5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:24.978693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be34261-9c45-4c08-a995-46f2b7707da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:24.998027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0be34261-9c45-4c08-a995-46f2b7707da5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:24.999227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0be34261-9c45-4c08-a995-46f2b7707da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:25.007454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:25.109824 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 180/363] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:25.207835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b93f-a1c7-4717-bbc0-a3f6061848f0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.208163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b93f-a1c7-4717-bbc0-a3f6061848f0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.208377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b93f-a1c7-4717-bbc0-a3f6061848f0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.209762 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 184/364] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:25.224979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.225207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.225483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.254444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:25.255631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:25.334777 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 181/365] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:25.464532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80b93f-a1c7-4717-bbc0-a3f6061848f0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:25.580416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80b93f-a1c7-4717-bbc0-a3f6061848f0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:25.617197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:25.617846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.618119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.618388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.629574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:25.634551 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:25.635428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:25.636222 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 185/366] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:25.643417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:25.652991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:25.713586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:25.774324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:25.816602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579aff7-937a-4db7-a9ef-d189568d1309 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:25.828066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49fca8-7fe6-483f-98b4-7bd33d0322a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:25.853273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:25.854672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.855158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.855722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.867012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:25.872960 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:25.873869 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:25.874711 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:25.877483 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 186/367] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:25.883600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:25.897599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:25.898232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:25.898510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:25.898781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:25.899473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:25.899760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:25.901198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:25.919286 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 182/368] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:25.924462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:25.983984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:25.995881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27349d3c-e41c-4d46-82c8-a332e884a1f6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.039578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.040603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.041115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.041708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.042460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:26.042824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.044296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.063193 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 187/369] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:26.070335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.131864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3bf61-0f6a-420a-b76e-5b22bb825788 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.201447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.202093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.202367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.202636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.207333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.228824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.230980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-18dc19c8-c4f5-4d9d-8603-93c5a0f4f5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:26.249929 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:26.250931 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:26.252182 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:26.252182 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:26.252182 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:26.252356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab944acf-1ef0-4f77-818f-e0b8f8a04ef8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.252432 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 183/370] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:26.252806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca97a7-1297-4d94-894c-5ea26069f5d9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.254868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca97a7-1297-4d94-894c-5ea26069f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.254868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca97a7-1297-4d94-894c-5ea26069f5d9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.255045 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 184/371] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:26.257255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca97a7-1297-4d94-894c-5ea26069f5d9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.299915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.300552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.300827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.301126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.314094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.315623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1000fdbf-c9f8-4166-a1b6-f5c6c95a1ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:26.331559 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:26.332505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:26.333396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:26.333396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:26.333396 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:26.333396 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 188/372] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:26.334038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.334285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.334554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.342523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.353283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:26.354495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:26.368599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca97a7-1297-4d94-894c-5ea26069f5d9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.403785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.404412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.404742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.405039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.405715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:26.406026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.407737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d6667-5e88-4be4-880b-dcba7b16ac06 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 185/373] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139fc3-d125-4414-980c-21ebef39e774 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139fc3-d125-4414-980c-21ebef39e774 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c139fc3-d125-4414-980c-21ebef39e774 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 186/374] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:26.423786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139fc3-d125-4414-980c-21ebef39e774 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.431304 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 189/375] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:26.437272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.496597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.545251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd6f9d-6e62-4aa9-abe3-25b26a0702d6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.572093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c139fc3-d125-4414-980c-21ebef39e774 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.587858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.590571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.590857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.591130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.593592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.601871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.603349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.611830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.612688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.613179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.613618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.614449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:26.614915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.616457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b472f7b-bb3f-4436-b18c-bebc311204b0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f4521112-f327-4204-8eea-2dafb49eaf79 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:26.617225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:26.618099 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:26.618989 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 190/376] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:26.619569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.619968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.620065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.633576 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 187/377] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:26.635466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f8ef-6547-4a65-b3d0-be54b14b935f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.635921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f8ef-6547-4a65-b3d0-be54b14b935f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.636374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8f8ef-6547-4a65-b3d0-be54b14b935f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.638115 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 188/378] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:26.638670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:26.639180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8f8ef-6547-4a65-b3d0-be54b14b935f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.639871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:26.708652 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 191/379] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:26.709449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.757413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8f8ef-6547-4a65-b3d0-be54b14b935f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.764439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.792415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.793043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.793325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.793589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.794311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:26.794612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.796076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5772759-8fbe-4692-ae0c-2f262a619fbd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.819065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fe268-c52d-4967-9c61-208dd0c01a16 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:26.836924 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 189/380] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:26.836924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.836924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.836924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.849524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:26.852945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:26.854367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:26.861203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:26.862382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:26.862670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:26.862897 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:26.870705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:26.872204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:26.884690 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:26.885722 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:26.886614 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 192/381] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:26.887158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:26.927060 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 190/382] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:26.927863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.002726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0620f5-35ee-4c6b-ab28-6e7d015b7a2d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.028036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.035432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee00ded-2dd2-4361-b91d-5c5196128cd4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.039782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.040415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.040689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.040986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.052386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:27.057695 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.058649 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:27.059463 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 193/383] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.060121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.075309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.076171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.076633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.076952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.087440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.088971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:27.103677 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.104551 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:27.105437 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:27.105437 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.105437 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:27.109230 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 191/384] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.109807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.114809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.171962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4ca1-fb04-46fe-829d-ecefab478bde None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.204940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.205541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.205807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.206067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.206786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.207082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.208540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.218004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335ff3-26e9-48f5-8cdb-d96c9b3d2f64 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.245211 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 194/385] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.245976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.254883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.255462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.255734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.256001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.266240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:27.271104 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.272021 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:27.272800 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 192/386] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.273502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.282628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.356703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282985a-a3b9-4315-93a1-6ab9ca504ab8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.358231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.373062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ce0-9662-43dd-8d94-9605a46057f5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.392689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.393316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.393589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.393856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.394520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.394818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.396220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.404063 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 195/387] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.404848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.410495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.411102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.411376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.411641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.412273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.412564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.413974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.425242 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 193/388] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.426026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.491940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.501813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb676ab-969a-4b8e-a66b-9aa5fbdce26d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.526578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338f88e-2d9e-473c-99a2-45bb7faf25c4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.537294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.537914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.538184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.538458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.549560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.551071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.558149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.558766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.559034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.559298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:27.565130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.566002 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:27.566846 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:27.566846 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.566846 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:27.566846 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 196/389] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.567060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.569761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.571276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:27.585784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.586729 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:27.587566 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:27.587566 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.587566 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:27.587566 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 194/390] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.587785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.588669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.677180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddcb11-ed96-4526-89ab-b829291f3db6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.684626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b581-88f8-4241-81d9-d02e88258b2e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.701342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.710780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.711396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.711673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.711920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.712572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.712898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.714279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.718084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.718700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.718976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.719257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.721965 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 197/391] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.722774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.731097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.732570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:27.747151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.748125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:27.748998 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:27.748998 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:27.748998 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:27.748998 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 195/392] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.749206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.807292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.829086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e704-d823-4a54-84d5-59dd780198eb None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.844174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff1077-7d15-4656-9f72-9f8676f40ca6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.864521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.865172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.865450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.865716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.872765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.874526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.878233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:27.878828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:27.879101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:27.879368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:27.879995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:27.880291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:27.881677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:27.885997 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:27.886835 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:27.887668 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 198/393] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:27.888131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.894094 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 196/394] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:27.894932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:27.924137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:27.987510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db185e-8ff7-4bc2-92bb-1758cdb8cbb5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:27.991442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38b2b-bbb8-4af9-a0c4-5321c50d17e8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.019526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.020148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.020396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.020658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.021323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.021619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.022989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.023911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.024537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.024817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.025121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.029682 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.035097 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 199/395] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.035924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.036036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.037421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:28.052506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.053648 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:28.054513 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:28.054513 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:28.054513 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:28.054513 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 197/396] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.054749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.135096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.139836 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740ed04-c230-407c-8903-ee26918dc358 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.153168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088ee20-0afa-4168-8ec0-f7e159532ec4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.173618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.174230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.174513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.174776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.175418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.175705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.177189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.185935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.186526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.186796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.187058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.187727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.188080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.188496 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 200/397] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.189312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.189718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.207172 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 198/398] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.208057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.251843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.294909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811db725-a2d7-4aba-ada4-6cb993bad742 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.306639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49423c3-8433-47a1-a93b-ad9a01567732 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.327026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.327697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.328052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.328319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.329048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.330488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.339094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.340086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.340732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.341029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.349861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.351312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.353529 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 201/399] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:28 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:28.354320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:28.364065 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.365203 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:28.366057 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 199/400] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.366512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.370174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.478420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32f896-dbdf-4bc1-ba3b-831bbb19ca4f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.483020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f62d1f-7bf2-4005-bea2-71c7f866bd74 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.497214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.520801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.521857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.522131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.522399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.524896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.525513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.526323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.526323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.526655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.526941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.528312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.530266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.531811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.544914 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 202/401] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.545772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:28.545908 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.546731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:28.547728 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 200/402] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.548295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.615034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.653478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90e2c-9acf-419c-bcad-817cc5a0f438 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.655432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ce7a-5afa-4892-86d0-ca241ed53ae5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.687785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.688648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.689043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.689405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.690708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.691314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.691591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.691864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.692553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.692875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.694331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.705091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=3741f090453c44c2b2d2d2b41af8330d, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.711760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.711909 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 201/403] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.711909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.728260 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 203/404] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:28 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:28.729658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.774674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.856915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b05797-f107-4791-8719-c7566d4b705c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.875651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196def0-7a05-42c1-ac10-56886737a5c0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:28.881468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:28.896279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.897000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.897278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.897546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.906067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.907661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.917711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:28.918324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:28.918597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:28.918870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:28.919596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:28.919899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:28.920508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:28.921393 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:28.922714 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 202/405] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:28.923271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:28.923338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:28.943377 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 204/406] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:28.944020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.043516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede390-f9ee-46ef-bd3d-7a225742689c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.054108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.074509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f11a-439a-4897-a946-7e0d3362e7c4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.098014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.098379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.098656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.098926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/1f1ad7b6fd7e432c9b56d2a5bad33854/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.114871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=1f1ad7b6fd7e432c9b56d2a5bad33854, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.116347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.126516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.128179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.129223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.129502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.130361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.130668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.132399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.134109 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 203/407] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:28 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/1f1ad7b6fd7e432c9b56d2a5bad33854/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:29.135379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.155545 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 205/408] 10.222.0.13 () {56 vars in 1139 bytes} [Sun Oct 16 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.161780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.173183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.257891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f4a5f-cc4b-46ed-a375-5284f3290ca9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.272303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537af4-1949-49f7-a034-792b2e32c5b9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.298034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.299199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.299709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.300220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.310352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.311007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.311285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.311560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.312927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.315265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.320993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.323810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.325448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:29.335772 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:29.337038 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:29.338277 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:29.338277 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:29.338277 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:29.341591 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 204/409] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:29.349842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:29.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:29.351728 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:29.352583 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:29.352583 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:29.352583 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:29.352583 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 206/410] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:29.362285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.448291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.467233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a3bd-3eca-4503-9cc9-0ad9dd68f72d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.477998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3f3b-721c-4d45-b6b3-60fa7508e40c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.505252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.505866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.506138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.506403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.507044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.507342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.508825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.518401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.519416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.519889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.520371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.521304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.521817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.522684 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 205/411] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.523681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.530386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.542411 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 207/412] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:29.548340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.617384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.637148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08aea76-5883-4e6f-b14b-7156f82440ac None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.665863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb3ea2-0159-484a-a139-70100131b20d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.673996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.675013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.675448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.675909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.683843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.685790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:29.699253 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:29.700125 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:29.701002 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:29.703586 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 206/413] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:29.712878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.716121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.716121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.716121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.716121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.717770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.731765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.734040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:29.755989 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:29.756906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:29.757744 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:29.758797 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 208/414] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:29.765430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:29.913728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb06e4-2453-4f3e-a705-40d3f74bc8c2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.955517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1682ca-f21e-48e0-8487-8cc4b15ec120 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:29.977261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:29.977751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:29.978367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:29.978636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:29.978904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:29.979609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:29.979916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:29.981450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:29.999743 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 207/415] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:30.008893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.016457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.017305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.017718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.018119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.018950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:30.020127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.021808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.059588 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 209/416] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:30.067669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:30.149863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:30.207045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e58861-3fec-48d3-ae0e-1eab34b790a1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.245364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fe0c2-c691-4c07-9a84-0ad740684a09 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:30.248279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.249125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.249561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.249974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/17c7b0785a6f43809e892a2aa4d7f8c5/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.274170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=17c7b0785a6f43809e892a2aa4d7f8c5, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.275972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0f2d5-ec83-4760-9728-8738ae44f644 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.300235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:30.301081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.304857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.304857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/f1f42430209d4ae9b1c0d039e1797a40/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.308485 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 210/417] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:30 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/17c7b0785a6f43809e892a2aa4d7f8c5/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:30.318499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=f1f42430209d4ae9b1c0d039e1797a40, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:30.320130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae4ea1-50ff-4450-98f1-819a95b03188 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:30.338153 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 208/418] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:30 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/f1f42430209d4ae9b1c0d039e1797a40/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:30.830981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636551-effc-46f4-9008-ba3a315ff580 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.831494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636551-effc-46f4-9008-ba3a315ff580 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.831866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636551-effc-46f4-9008-ba3a315ff580 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.833684 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 211/419] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:30.839232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdcd5f-cfa6-42d8-998f-d3ee9a2f96d7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:30.839631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdcd5f-cfa6-42d8-998f-d3ee9a2f96d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:30.839993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdcd5f-cfa6-42d8-998f-d3ee9a2f96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:30.858638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5bdcd5f-cfa6-42d8-998f-d3ee9a2f96d7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:30.859904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5bdcd5f-cfa6-42d8-998f-d3ee9a2f96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:30.939782 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 209/420] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:31.127466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac158-763a-4cfc-a227-3e9918f25186 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.128007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac158-763a-4cfc-a227-3e9918f25186 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.128007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ac158-763a-4cfc-a227-3e9918f25186 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.129607 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 212/421] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:31.135192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.135475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.135746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.155765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:31.157048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:31.201405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.246200 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 210/422] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:31.300630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac158-763a-4cfc-a227-3e9918f25186 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.331421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.432337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ac158-763a-4cfc-a227-3e9918f25186 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.467111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.467746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.468019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.468282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.478728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:31.483582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:31.484451 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:31.485388 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 213/423] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:31.494168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.629454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56171e54-9be5-4c95-a0df-4294b317a2c4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.674078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.674685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.674961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.675220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.675882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:31.676181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.677596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680d63d-0cd5-42f0-a1f8-263771f9a1cb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.693692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 211/424] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:31.699601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.725602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310637-d555-4d26-abf1-a034dbfd2f88 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.725883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310637-d555-4d26-abf1-a034dbfd2f88 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.726328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da310637-d555-4d26-abf1-a034dbfd2f88 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.728422 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 212/425] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:31.740047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.740321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.740588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.768744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:31.769975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:31.799764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.822462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:31.842564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c28c39-421c-496c-8739-054788fcf707 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:31.848133 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 213/426] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:31.849027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.910228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:31.910864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:31.911183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:31.911452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:31.933730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:31.935261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:31.955992 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:31.956940 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:31.957807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:31.957807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:31.957807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:31.957807 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 214/427] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:31.964042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:31.985403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd03e1-1e0d-42c6-a430-7f406a21c5ff None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.066478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.067121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.067391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.067655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.086756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943a9d0-588d-4767-9cd7-45f5b568da06 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.107698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:32.113077 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.113939 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:32.114731 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 214/428] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.122560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.126763 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.127381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.127651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.128241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.128548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.128871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.130390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.132000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.143560 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 215/429] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.154215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.170307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.238614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dada0-23c4-4761-bafb-38fd7856b6b1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.251662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6526-6f91-490c-83d5-f5d1b40ba302 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.276028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.276731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.277029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.277296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.277949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.278244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.279818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.286965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.287586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.287853 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.288117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.288379 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 215/430] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.289192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.300371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.301837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:32.313221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.314110 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:32.315087 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 216/431] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:32.316212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.368878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.386128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.400292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9868c-bfac-4fc3-a4f7-ad76b6aa6210 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.413850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb6d88-02a1-4ddd-9c6b-c4757978980a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.436116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.436872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.437150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.437519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.447817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.448448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.448640 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:32.448791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.448996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:32.454063 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.456089 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 216/432] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.458031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.460901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.468873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:32.475752 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.477847 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:32.479987 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:32.479987 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.479987 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:32.479987 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 217/433] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.479987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.563242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb4ac-dc19-4b34-8c77-202db44ebc7a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.581473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299b01-bc79-4fde-bb7b-95a14b0997ca None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.588590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.601225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.601932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.602208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.602474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.603201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.603565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.605328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.616125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.616736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.617034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.617295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.617952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.618241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.619591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.624749 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 217/434] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.625781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.628468 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 218/435] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.630015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.634852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.731618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c30ff-1a5f-4afa-979b-bea74745c794 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.736086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b249db-7a49-4fb8-88b6-1a7e592d9e35 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.767113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.767728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.768000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.768377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.768981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:32.769278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.770645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.771601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.772348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.772612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.772997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.784061 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 218/436] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:32.784321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.784788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.790011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:32.805683 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.807785 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:32.809998 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:32.809998 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.809998 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:32.809998 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 219/437] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.809998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.831210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.857286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:32.895326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83817f-2b10-4bfa-ad5c-68e993e16389 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.913737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f824a4a-dfe2-4dec-a5f1-d3f0e33aaeb2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:32.933210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.934088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.934425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.934791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.947960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.949859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.955777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:32.956430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:32.956701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:32.957017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:32.966706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:32.967321 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.969198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:32.971213 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:32.971213 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:32.971213 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:32.971426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:32.971507 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 219/438] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.971507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:32.981184 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:32.983102 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 220/439] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:32.985157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.077578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.081090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed461c6-862d-42a5-b51b-0c734d250bf3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.098549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75387497-484f-4d7d-9e1d-b571b2d61dfe None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.098938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.115626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.116235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.116516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.116777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.117462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.117763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.119148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 220/440] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.131338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.132325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.133442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.133868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.134282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.135051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.135480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.136882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71efad5-ecd3-4c4d-a886-d9aa25827b9f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.148698 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 221/441] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.149902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476497-8268-4041-ab7f-fb9e7af66865 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.150179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476497-8268-4041-ab7f-fb9e7af66865 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.150444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476497-8268-4041-ab7f-fb9e7af66865 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.151792 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 222/442] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:33.152607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ae07-17f7-48b2-b84b-9e1dcdf96077 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.152921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ae07-17f7-48b2-b84b-9e1dcdf96077 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.153314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ae07-17f7-48b2-b84b-9e1dcdf96077 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.154274 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 223/443] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:33.154987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0ae07-17f7-48b2-b84b-9e1dcdf96077 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.233277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767cc52-01e0-48a6-a55f-2a56adb1a18e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.256324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0ae07-17f7-48b2-b84b-9e1dcdf96077 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.268026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.268618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.268940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.269249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.270100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.270398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.271833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.292989 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 221/444] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.292989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.293206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.293206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.293206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.293206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.298172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.299602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.302102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6058a653-8943-482d-a748-fad0a7d3f125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:33.311626 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:33.312470 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 224/445] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:33.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515175cd-f57e-4b57-ada8-405a1d3c400b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.314519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515175cd-f57e-4b57-ada8-405a1d3c400b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.314519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515175cd-f57e-4b57-ada8-405a1d3c400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.329022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.331605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-515175cd-f57e-4b57-ada8-405a1d3c400b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:33.332813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-515175cd-f57e-4b57-ada8-405a1d3c400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:33.402551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e18bb-e935-49f5-8638-d57ca2f90aba None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.406151 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 225/446] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:33.407455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.407731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.407998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.426062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:33.427238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:33.447493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.448129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.448402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.448667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.457169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.458643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:33.470219 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:33.471083 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 222/447] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:33.477431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.503570 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 226/448] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:33.504226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.569492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.598077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.608111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551b5d-e552-497d-816d-f6e1ae5e7840 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.612670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0883f-4304-4474-9c61-a7fa924abc66 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.648300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.648920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.649199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.649464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.650144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.650447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.651919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.652740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.653807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.654699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.655178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.665542 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 227/449] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.666718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.729798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.731290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.771437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe0226-c9fd-4a63-a5cf-6fdb63c33c73 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.790890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.805718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.806325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.806602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.806871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.807627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:33.807925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.809397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.825571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:33.826371 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 228/450] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:33.827047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.836806 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 223/451] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:33.837948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.925391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed66f4-4a03-4158-9944-1fa7814f7e06 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.934157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7f007-ecc5-4f9d-8c3a-32924d545494 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:33.958109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.958757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.959033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.959313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/5fdb324c26934b11b3c4fe8dff574d88/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.966527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:33.967148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:33.967426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:33.967694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:33.972988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=5fdb324c26934b11b3c4fe8dff574d88, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:33.974422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:33.977636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:33.982589 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:33.983683 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:33.984636 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 224/452] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:33.987140 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 229/453] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:33 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/5fdb324c26934b11b3c4fe8dff574d88/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:33.988241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:33.989802 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.020815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.055689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.109236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90753ee-309f-42eb-8b54-92c607f875b6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.115840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b7fd7-739e-414c-b9ab-f09930520235 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.148219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.148883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.149160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.149427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.153022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.153662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.153940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.154210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.161312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:34.166025 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:34.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:34.167676 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:34.168741 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 225/454] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:34.169879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.232169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.233597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.262455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.276092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163090f3-ab71-45f3-a9c3-e55d70f704e3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.293377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.310770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.311402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.311682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.311951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.322508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.323992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:34.338649 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:34.339745 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:34.340600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:34.340600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.340600 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:34.340600 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 226/455] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:34.340810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.353476 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 230/456] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:34.353476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.447961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fcd52-2273-4d50-8740-52db35fcc41d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.455146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e745b99-4a0a-4666-9e8f-67a2be7438af None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.482265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.482774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.483066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.483305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.483961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:34.484258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.484792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.485736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.498562 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 227/457] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:34.498731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.498865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.498946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.512303 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 231/458] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:34.514059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.531276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.608681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08c1cb-58ee-4a4f-88d7-99ee1918130e None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.620694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbfa37f-1032-4b4d-8349-f23fa47dfaef None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.643390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.643996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.644266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.644520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.645186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:34.645481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.646839 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.655604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.656222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.656557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.656821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.659184 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 228/459] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:34.659815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.672035 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.673924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:34.690770 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:34.691774 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:34.697697 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:34.697697 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.697697 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:34.697697 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 232/460] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:34.697697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.745007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.758659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.768911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f38158-a644-41cf-a1e0-af209b07fdba None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.804490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.804702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcacecf-615d-4e4b-8628-f915799a4fd1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.805141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.805411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.805677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.815670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.817159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:34.831934 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:34.832827 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:34.833704 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:34.833704 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.833704 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:34.833704 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 229/461] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:34.833938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.845030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.845698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.845968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.846214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.858002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.859667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:34.876271 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:34.877310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:34.878146 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:34.878146 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:34.878146 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:34.878146 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 233/462] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:34.878796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:34.949540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b66eaa-52a9-4e7f-b786-180923eb27cc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.974340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:34.980023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cbaa1-9cda-4dc1-9040-fb4034c6923f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:34.983225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:34.983926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:34.984199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:34.984466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:34.991318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:34.992774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:35.004082 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:35.005111 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 230/463] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:35.005940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.012050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.024281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.025066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.025703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.025976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.026617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.026912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.028699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.045933 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 234/464] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.045933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.114462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73109c98-95e4-4065-ba3e-dc51e5cf66b4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.149114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.149696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.149969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.150246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.150951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.151268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.152747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.154820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd845-6278-4dbd-90f8-769ce0bf663e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.164907 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 231/465] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.165723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.198149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.198906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.199178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.199441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.200077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.200370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.201893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.214585 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 235/466] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.215444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.231768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.235331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.277995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc10e8-6031-4b0c-95ef-51f8943715a2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.312023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.312714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.313019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.313340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.314031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.314434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.315783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.322042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93ca49-1c75-481e-9260-b32f87303662 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.331901 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 232/467] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.331901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.366636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.367271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.367545 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.367817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.374861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.376416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:35.388221 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:35.389259 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:35.390141 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 236/468] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:35.390594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.443144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66adb44-9aae-416c-8112-d262d1eda16d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.465149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.467766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.478382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.479011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.479285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.479547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.487306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.488763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.496256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7033e22-6506-421e-ae4e-a9756605dd3f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:35.500605 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:35.501501 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:35.502397 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 233/469] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:35.502967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.536963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.537512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.537783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.538055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.546096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.547616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:35.559084 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:35.560130 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 237/470] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:35.561054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.612927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fade5-b46d-40e5-99ca-43f8379f13b4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.644856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.645462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.645732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.646001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.646722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=3741f090453c44c2b2d2d2b41af8330d) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.647019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.648482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.664868 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 234/471] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/role_assignments?user.id=3741f090453c44c2b2d2d2b41af8330d&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.664868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.679130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928c03-3462-4dae-996b-0a8e50dc1a51 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.722807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.723567 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.723930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.726032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.726032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.726032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.727298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.730542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.747241 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 238/472] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.748344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.749200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:35.807221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81cb4b-728c-4984-809d-f388fa2a8183 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.860631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.861669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.862678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.862678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.862914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.863214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.864653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.881848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1e0af-a898-40fd-95b0-0404e458f69a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:35.885377 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 235/473] 10.222.0.13 () {56 vars in 1137 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.886311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:35.935054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:35.935676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:35.935992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:35.936274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:35.937056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:35.937362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:35.938862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:35.968865 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 239/474] 10.222.0.13 () {56 vars in 1139 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:35.968865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.011020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf6119-8182-4276-b36a-c086818ddd62 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.015425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.037360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.058151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.059222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.059693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.060219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.061192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=1f1ad7b6fd7e432c9b56d2a5bad33854) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:36.061695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.063427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.070560 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 236/475] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/role_assignments?user.id=1f1ad7b6fd7e432c9b56d2a5bad33854&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:36.071846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.097451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02ea8b-2aef-43d7-b47a-2c5a3840b083 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.152494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.153652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.154124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.154582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.202708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e703a8-441e-449d-a26c-ef1ca991dd3f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.240805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.241370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.241985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.242255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.242519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.244002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d9bb4-a31d-4aac-97ed-a15e58252fe3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.286812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.312342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.331220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.332695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24689396-e412-43c2-b942-4449b9ece6ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.377922 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 240/476] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:36.379250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde95bd-11cd-4623-ba99-d9899ce05f9b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.379485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde95bd-11cd-4623-ba99-d9899ce05f9b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.379751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde95bd-11cd-4623-ba99-d9899ce05f9b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.384991 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 241/477] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:36.384991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde95bd-11cd-4623-ba99-d9899ce05f9b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.456764 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 237/478] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:36.458430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.458900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.459356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.478170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:36.479697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:36.519431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde95bd-11cd-4623-ba99-d9899ce05f9b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.555868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.556498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.556767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.557068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.567701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.567848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.569441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.575631 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 238/479] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:36.577212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:36.596204 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:36.597205 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:36.598052 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:36.598052 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:36.598052 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:36.598052 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 242/480] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:36.603324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.611008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.702996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5d57b-a639-4b8a-82ab-baa7b3ad88fd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.768219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.768861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.769134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.769400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.779397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.780875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:36.795621 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:36.796506 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:36.797570 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:36.797570 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:36.797570 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:36.797570 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 239/481] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:36.803782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.809447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6414b-a9ae-4184-bc2d-fec1ebeea925 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:36.877397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:36.877929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:36.878199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:36.878461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:36.879159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:36.879449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:36.880911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:36.898838 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 243/482] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:36.908012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:36.908152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:36.978147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20db00c-7f56-4a2d-95cc-1d4c4caa97bf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.007258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.024457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.025103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.025379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.025650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.026295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.026601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.027990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.048342 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 240/483] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.048342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.065469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e1a7a-f38b-43a5-825f-9f552291dc44 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.117480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.118645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.119116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.119524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.131011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.133076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:37.149346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:37.150346 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:37.151201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:37.158017 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 244/484] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:37.158017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.183688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edc76-4df3-40d8-9925-435b1b3a52b8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.197828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.227146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.227770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.228040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.228306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.242068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:37.248497 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:37.249562 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:37.250545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:37.252910 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 241/485] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:37.253919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.287264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c808f9-aefc-483d-acd8-502cb4a26890 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.310665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.322443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.323075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.323405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.323662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.330980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.332253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:37.343950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:37.344807 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:37.345682 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:37.349853 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 245/486] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:37.350681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.366183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42218db0-d834-4cbc-bedd-be143a8ce8db None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.403863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.404821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.405318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.405784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.406723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.407243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.408987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.426688 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 242/487] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.427877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.457832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1731d-45fd-49f6-8746-2a65e4e7226f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.459719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.494302 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.494922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.495194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.495457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.496117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.496410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.497837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.511122 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 246/488] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.512074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.536622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f9fd-4880-4774-a7a8-3f8160b20fd1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.561250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.571531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.572439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.573220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.573688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.574591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.575089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.576762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.590701 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 243/489] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.591904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.621452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f144ec-6954-46e4-b544-c3a3abdf5d78 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.656710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.657109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.657382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.657652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.658369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=f1f42430209d4ae9b1c0d039e1797a40) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.658744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.660101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.671569 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 247/490] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/role_assignments?user.id=f1f42430209d4ae9b1c0d039e1797a40&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.672594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.693456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.699351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503761e0-301e-4cb7-bb7b-473a0ba92b25 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.739944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.741411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.741906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.742409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.754220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.756086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:37.777178 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:37.778151 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:37.779001 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:37.779001 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:37.779001 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:37.782264 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 244/491] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:37.789907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:37.890216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5fab5-1991-45b8-a9e0-aa8f628f26d1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.921613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:37.926949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:37.927723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.928532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.929003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.929870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=17c7b0785a6f43809e892a2aa4d7f8c5) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:37.931006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:37.932548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972db51-363f-4558-a535-621821fb5d94 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:37.944995 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 248/492] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/role_assignments?user.id=17c7b0785a6f43809e892a2aa4d7f8c5&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:37.975280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967da2-bffb-4245-a0da-6a4209125fd2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.975638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967da2-bffb-4245-a0da-6a4209125fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.975822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967da2-bffb-4245-a0da-6a4209125fd2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:37.978196 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 249/493] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:37.987399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ce952-563a-48ee-b39c-6ecd81b89f59 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:37.990452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:37.990703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:37.990968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.027193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:38.029454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:38.034772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.034772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.035082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.035293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.035943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:38.036242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.037720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.062668 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 245/494] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:38.068070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.073334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.163215 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 250/495] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:38.201178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356156e-e73c-40d6-a397-033fe00cb8d9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.242894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.243535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.243812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.244083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.253567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.255042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:38.269320 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:38.270268 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:38.271255 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:38.273872 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 246/496] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:38.279354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.419280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8aad-368d-408c-9499-868de5e6ddba None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.422690 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.457294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.470236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.471198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.471674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.472143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.473188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:38.473705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.475371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.499251 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 251/497] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:38.505907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.581210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.617438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034ce88-3493-4331-b9e2-901ad80047b5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.646364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a2c34-29ac-43dc-97f4-eaad8debe1ed None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.657674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.658337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.658607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.658872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.673660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ba184702-57a4-47b0-9910-ab4e3f94d32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:38.680429 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:38.681394 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:38.682317 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 247/498] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:38.683658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d054b6-0e90-4758-b303-41f836a160d9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.683658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d054b6-0e90-4758-b303-41f836a160d9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.683658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d054b6-0e90-4758-b303-41f836a160d9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.688906 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 248/499] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:38.690823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d054b6-0e90-4758-b303-41f836a160d9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.696960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.697591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.697866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.698139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.746912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.791473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.793432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.814289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d054b6-0e90-4758-b303-41f836a160d9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:38.837458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:38.849226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:38.849895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.850227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.850497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.851264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:38.851451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:38.852856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a348681-4959-4218-ba9b-104ef4de50b2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:38.862140 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 249/500] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:38.863414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:38.863742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:38.864058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:38.882692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:38.884172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:38.908446 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 252/501] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 16 00:43:38.909696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.960861 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 250/502] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:38.960861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:38.995129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.057609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de0ea-b51a-40fa-9412-fbc33e8137c0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.075303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29d2a2-6e5c-4dbd-83ca-e0f0f237ff5a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.075899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.095257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.095905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.096185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.096456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.117706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.119201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.134318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.134995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.135276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.135546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.148068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.149646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:39.166870 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:39.167832 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:39.168708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:39.168708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.168708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:39.172014 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 251/503] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:39.175275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:39.176479 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:39.177389 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:39.178357 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:39.178357 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.178357 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:39.185665 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 253/504] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:39.186548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.339465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f826-7c91-4987-aa5c-04190265c25b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.348023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88847-4ee5-41b8-8696-8fed35e6113a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.365775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.377335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.378837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.379417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.380215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.381645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:39.382196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.384450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.394497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.395119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.395396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.395664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.396314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:39.396613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.398623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.408195 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 252/505] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:39.409445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.412172 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 254/506] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:39.418232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.442538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.524056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab97be8-c8e7-4b2f-ac6b-291ac8148279 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.537213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12701f8b-b7ac-4adf-9517-c541864b9738 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.567677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.568412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.568790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.569108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.576521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.577193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.577484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.577751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.580293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.581880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.584746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.586227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:39.597465 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:39.598384 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:39.599646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:39.599646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:39.599646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:39.600007 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:39.600771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:39.601665 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:39.602226 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 253/508] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:39.602226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.605579 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 255/508] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:39.605579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.641695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.692725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.709312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef284-7551-4610-95ce-7ca6164869e8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.715880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023a038-ed4c-4d8a-903b-d3a02ab53af0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.745546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.746250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.746596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.746929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.747694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:39.748061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.749643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.752507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.753170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.753447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.753719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.761630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.763099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.765230 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 256/509] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:39.766292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:39.775315 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:39.777226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:39.779175 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:39.785254 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 254/510] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:39.785254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.865060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:39.872111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f332de9-a31a-4fc3-82e0-7daab55c6d51 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.889276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0646c-9e12-4cee-8feb-3572803047f4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:39.909014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.909715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.910061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.910488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.911218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:39.911580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.913206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.925237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:39.925864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:39.926140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:39.926414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:39.927278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=5fdb324c26934b11b3c4fe8dff574d88) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:39.927601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:39.928555 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 257/511] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:39.929556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.934240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:39.941713 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 255/512] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/role_assignments?user.id=5fdb324c26934b11b3c4fe8dff574d88&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:39.942864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:39.946002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.062407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99077a6e-7f1b-4125-a27d-bc93f2a9cf57 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.102896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.103521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.103791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b468b-8a9e-4c52-9ef0-127494288db9 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.103895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.104057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.104716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.106248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85044e88-2fa7-4126-88b3-f42982cf559b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.131622 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 256/513] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:43:39 2022] POST /identity/v3/users => generated 254 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:40.137855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc64e-84de-41d6-a40c-ab866e2dfe96 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.138194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc64e-84de-41d6-a40c-ab866e2dfe96 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.138398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cc64e-84de-41d6-a40c-ab866e2dfe96 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.140234 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 257/514] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:40.146845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.147278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.147658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.149548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.150190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.150457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.150723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.151508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:40.151813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.153387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.174959 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 258/515] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:43:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:40.184707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:40.184934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.186129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:40.212950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.278599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.303460 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 258/516] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:40.330820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afde59-f123-44f0-83d7-f6da40edba1f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.369486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.370129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.370407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.370677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.382520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.383940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f3d3d03c-7dc0-4a7e-9a7a-aa2fd387a422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:40.401298 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:40.402295 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:40.403288 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:40.403288 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:40.403288 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:40.403288 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 259/517] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:40.408768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.507079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49db3a-4f76-49d0-9c1d-69eef5d2ffbc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.507406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49db3a-4f76-49d0-9c1d-69eef5d2ffbc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.507616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49db3a-4f76-49d0-9c1d-69eef5d2ffbc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.510406 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 260/518] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:40.514426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.514700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.514966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.517560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06b758-a0c7-4fab-b5e3-8285d8a696d5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.534439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:40.535648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:40.581437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.582050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.582317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.582579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.583220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:40.583512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.584911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.604172 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 259/519] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:40.605755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.621269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.637039 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 261/520] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:40.637976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.670418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.744780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99673-7f1f-441e-b7d2-f0af2ccabac7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.780458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.781377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.781702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.781969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.782598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.783979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:40.795583 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:40.796670 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:40.797560 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 260/521] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:40.804331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.847309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d913-0ecb-4eb5-9844-ea8939388123 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.923496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.924056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.924324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.924642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.934371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.935817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.944735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329b291-f99a-4652-92bf-0f555b8e2d87 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:40.953151 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:40.954041 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:40.954927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:40.957301 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 262/522] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:40.958391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:40.961246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:40.984577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:40.985210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:40.985479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:40.985740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:40.986798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:40.987086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:40.988562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:40.997934 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 261/523] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:40.997934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.032280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.104052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f19d9-0735-4718-a091-d02d6d581f88 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.112791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8508798-7c6d-42a9-94e5-2c25cbb38983 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.144596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.145344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.145894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.146250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.147316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.149153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.155607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.156260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.156534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.156807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.157523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.157823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.159333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:41.162667 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:41.163622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:41.165280 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 263/524] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:41.167263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.180245 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 262/525] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.181507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.224738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.293696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35f510-c238-4269-a420-00e886e491b7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.313349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.315182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0d2a-4eb0-4fab-a9ce-c423486b9200 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.335068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.335893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.336354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.336620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.337294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.337587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.339070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.349721 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 264/526] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.349721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.374029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.374650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.374971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.375243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.375876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.376177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.377619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.390032 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 263/527] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:41.397971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:41.506403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39bc3-a5ad-4032-962c-3fc513defc68 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.570838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.571506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.571782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.572042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.574178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:41.577323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=3741f090453c44c2b2d2d2b41af8330d, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.578962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfea913-2d32-4966-8d7a-ff26f5791f1b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.583403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8310-04a3-4c18-8aa4-1bff8026c89f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:41.627396 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 265/528] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:41 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:41.656865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:41.656865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:41.656865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:41.656865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:41.657323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] RBAC: Adding query filter params (type=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:41.657323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:41.659454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e813-619e-492c-aab9-44d26cc69828 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:41.666777 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 264/529] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:42.852870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053330-3dab-415c-b9af-e9ecc469fa16 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.852870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053330-3dab-415c-b9af-e9ecc469fa16 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.852870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d053330-3dab-415c-b9af-e9ecc469fa16 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.854974 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 266/530] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:42.865418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.866286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.866781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.873211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8d3a-1072-4c6e-bc54-754be8593d86 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.873488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8d3a-1072-4c6e-bc54-754be8593d86 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.873752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d8d3a-1072-4c6e-bc54-754be8593d86 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.875516 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 267/531] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:42.880583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:42.880886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:42.881159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:42.890679 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:42.893617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:42.913184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:42.916739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:42.992525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.020378 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 265/532] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:43.041405 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 268/533] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:43.403761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.428369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.556085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.570502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1393c7d3-772c-4b4f-8c63-b994126aa817 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.610441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5184c50-f0a0-4dc8-b0eb-b8fbe86d90a6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.632419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.633135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.633406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.633677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.653156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:43.658109 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:43.659053 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:43.659878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:43.660502 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 266/534] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:43.667908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.687194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.687818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.688094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.688362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.705698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:43.710582 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:43.711478 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:43.712291 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 269/535] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:43.722195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.783091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:43.880293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bf1d-8134-4fb0-845c-361d9676af19 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.897931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74744a5-57b7-499b-8eb6-75fdb779b998 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:43.952472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.953060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.953335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.953601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.954276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:43.954578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:43.956972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:43.969121 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 267/536] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:43.974573 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:43.978097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:43.978988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:43.979477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:43.979927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:43.980797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:43.981308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:43.982890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:43.999107 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 270/537] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:43.999292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.006051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.133579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd1947-bc99-48de-b7ea-6d47ef0d57aa None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.147335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.155247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b47a2-56d2-4abd-af49-0c9af3673de5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.170248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.171126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.171595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.171930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.185184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.187369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.193644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.194285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.194671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.194937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0d796d68-07de-4af3-bcb7-f1b905d4d34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:44.203457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:44.204353 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:44.205793 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:44.205793 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:44.205793 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:44.205793 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 268/538] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:44.206050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.207204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa2d1-cde7-4ca5-aced-7136f4a85a9b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.207204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa2d1-cde7-4ca5-aced-7136f4a85a9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.207363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.207431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8fa2d1-cde7-4ca5-aced-7136f4a85a9b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.208610 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 269/539] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:44.209680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d116eb-fc46-46c2-a10f-4eac0cf515dd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.209680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d116eb-fc46-46c2-a10f-4eac0cf515dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.211344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d116eb-fc46-46c2-a10f-4eac0cf515dd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.211344 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 270/540] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:44.214218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105243ed-069b-4b58-8b9b-0173407d00fb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.214595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105243ed-069b-4b58-8b9b-0173407d00fb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.214953 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105243ed-069b-4b58-8b9b-0173407d00fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:44.226109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:44.227097 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:44.233178 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:44.233178 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:44.233178 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:44.233178 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 271/541] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:44.233178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.238064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-105243ed-069b-4b58-8b9b-0173407d00fb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:44.239236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-105243ed-069b-4b58-8b9b-0173407d00fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:44.299430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.306187 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 271/542] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 16 00:43:44.307552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.307835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.308097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.326649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:44.327900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:44.354613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193053-02a2-44b4-9211-21e501da835f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.395876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.396857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.397326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.397846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.398674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:44.399176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.400734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02effdd4-3dff-4794-bf20-8dee244832d0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.401206 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 272/543] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:44.402122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.415949 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 272/544] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:44.417635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b3fe-499d-4195-8d28-828565872a97 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.418594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b3fe-499d-4195-8d28-828565872a97 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.419058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b3fe-499d-4195-8d28-828565872a97 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.420688 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 273/545] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:44.424777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b3fe-499d-4195-8d28-828565872a97 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.435340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.518277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6e5c-48f1-4580-8929-7816b5add055 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.539390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1b3fe-499d-4195-8d28-828565872a97 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.545722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.554227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.554934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.555211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.555479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.556134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:44.556426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.557973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b36584-5811-4aac-8330-d17b7ddeaac5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.574940 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 273/546] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:44.574940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.574940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.574940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.589560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.590197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.590472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.590727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.591554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:44.592769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:44.598399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.599845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:44.613269 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:44.614216 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 274/547] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:44.615152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.664021 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 274/548] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 16 00:43:44.664645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.693610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.732195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d8bc3-6256-4163-aa0c-8e0dd61ff5b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.766681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.767310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.767579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.767842 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.770467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7896bbd-9a29-497d-9678-e3b02eaeab73 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.775364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.777009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.787714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:44.790119 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:44.791040 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 275/549] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:44.792003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.811475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.812115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.812487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.812653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.813328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.814700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.836978 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 275/550] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:44 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:44.836978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:44.920285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718b2c3-313a-42be-90d3-a602659e0daa None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:44.951804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:44.977411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:44.978049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:44.978325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:44.978589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:44.979339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:44.979640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:44.981465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:44.986185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084905f-515c-4272-bea0-9f4ece17ff13 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.005516 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 276/551] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.005516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.026710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.027263 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.027536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.027799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.038921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:45.044761 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.045926 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 276/552] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:45.049689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.093278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.129547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a488fee-a018-4dda-a580-f63f9344e814 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.162809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0291610-9e00-4ade-8cad-f9d1dd9a9687 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.170961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.171619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.171891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.172481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.173251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.173838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.175291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.196715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.197347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.197623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.197888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.198533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.199426 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 277/553] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.199908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.200209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.220898 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 277/554] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:45 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:45.220898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.256917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.332268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6465bb-f947-4877-9751-fa61351cb620 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.353496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.367355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ff37-76c2-485d-a1cf-153f6b63c2e5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.378995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.380419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.380979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.381402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.395989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.398404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.411904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.412122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.412353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.412660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.413595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.413696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.415179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:45.419449 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.420412 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:45.421400 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:45.421400 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.421400 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:45.421400 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 278/555] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:45.422262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.429142 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 278/556] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.430074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.532764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.546256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e11f0-267b-4b9d-ac9e-f8dbae4519ba None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.551578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b0ede-1ac4-4d6d-8e15-64653c5fb58d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.591584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.592139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.592394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.592657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.596446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.597312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.597785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.598260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.599088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.599591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.602235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.603917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.606180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.618362 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 279/557] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.619575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:45.625024 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.625955 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:45.626824 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:45.626824 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.626824 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:45.630746 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 279/558] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:45.632211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.642928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.750456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d066d69-afe7-4d2d-86d1-aa0f311624d7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.758673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f950f-dbf8-4ce9-8f76-39a988b1a528 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.788215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.788878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.789151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.789419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.798942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.799894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.800092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.800545 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.801052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.801394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.808723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.810570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:45.816494 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.817611 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:45.818508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:45.818508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:45.818508 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:45.822249 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 280/559] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:45.823080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:45.825417 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:45.826277 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:45.827153 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:45.829706 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 280/560] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:45.830679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.833656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.894459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:45.930690 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc6b35-9033-45a5-8557-0b8088e75b97 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.951484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18b20-9907-4868-b397-ee2790a3d00c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:45.965152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.965757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.966035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.966397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.967031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.967345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:45.968897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:45.986690 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 281/561] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:45.987588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:45.995002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:45.995897 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:45.996363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:45.997194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:45.997846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:45.999785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.001187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.019286 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 281/562] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.020701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.095449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.105310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0812a7-903e-4913-b12d-e4d5beba346a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.134692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.145990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.147087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.147755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.148161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.149012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:46.149486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.150028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d75b-fad4-4023-b909-9fdaf0575036 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.151300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.166863 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 282/563] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.167998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.193664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.194459 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.194834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.195195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.203017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.205297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:46.218609 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:46.219730 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:46.220827 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:46.222849 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 282/564] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:46.224074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.287838 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9583275-2992-4108-bf8b-328f2925bbff None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.323229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.323900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.324275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.324715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.332539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.334373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.343056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01f076-a28b-43b7-8dab-2b118f65315f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:46.346326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:46.347446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:43:46.348584 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:46.349639 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 283/565] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:46.350476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.373340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.387207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.388117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.388616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.389111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/270eef82009744d8b43e43c86514e519/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.406439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.408466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=270eef82009744d8b43e43c86514e519, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.410202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.429792 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 283/566] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:46 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/270eef82009744d8b43e43c86514e519/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:46.430900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.475095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa624c0-6c74-4c0a-80a5-c78c02fbd4ca None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.516390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.517058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.517336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.517608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.524858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:46.524858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.524858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.535438 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 284/567] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.541488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.619496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40a8ae-6f29-4d50-8718-2a6ec31b9c1d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.659881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.660469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.660747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.661045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.661833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:46.662139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.663608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.683308 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 284/568] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:46.688958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:46.722723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.724799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec7740-fb43-4f60-b14e-c7c07c329dcc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.737927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:46.766142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.767149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.767646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.768058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/5fdb324c26934b11b3c4fe8dff574d88/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.770256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=5fdb324c26934b11b3c4fe8dff574d88, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.772003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.789363 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 285/569] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:46 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/5fdb324c26934b11b3c4fe8dff574d88/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:43:46.810056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c830025-d448-488d-9a70-3fc24a2a4bee None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:46.850131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:46.850834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:46.851114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:46.851380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:46.925463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:46.926914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce4120-d5bd-4994-973a-febe9843c5cd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:46.965564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.055399 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 285/570] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 16 00:43:47.060904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.184679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015f88-c434-4b8c-ac21-33fb1f3e2357 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.185009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015f88-c434-4b8c-ac21-33fb1f3e2357 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.185176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb015f88-c434-4b8c-ac21-33fb1f3e2357 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.188802 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 286/571] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:47.195303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.195914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.196996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.210029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db9593-92e8-4364-ba8f-7d72977d8f50 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:47.227012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:47.229204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:47.260126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.260772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.261078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.261348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.283049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.284528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:47.315719 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:47.316800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:47.318195 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:47.318195 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:47.318195 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:47.319452 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 286/572] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:47.325781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.353373 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 287/573] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:43:47.354588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.462815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7b143-a090-48a9-b40d-2dba40166962 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:47.509719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.510362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.510638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.510906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.511579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:47.511881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.513428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec37fa-497a-4965-a46b-1e397d462e87 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.530432 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 287/574] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:47.536188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.607658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.618357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a245d6-d987-408a-80cf-95ac624e26fe None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.618659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a245d6-d987-408a-80cf-95ac624e26fe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.618945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a245d6-d987-408a-80cf-95ac624e26fe None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.620546 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 288/575] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:47.625485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.629988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.630278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.648881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40491f43-36f4-4784-ad25-f5b4482adf13 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:47.661955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:47.663275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:47.691416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.692055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.692331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.692598 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.699725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.701209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:47.712796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:47.713864 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 288/576] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:47.715280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.746650 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 289/577] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:47.747841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.765582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.829153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1c271-213f-4945-910c-4b1147fc1af7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:47.850081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:47.864930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:47.865580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:47.865864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:47.866141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:47.866734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:47.868450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:47.878046 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:47.879011 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:47.879863 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 289/578] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:47.889075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:47.969643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237a722-7490-46f6-a298-8e76d9293164 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.030270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.030934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.031208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.031471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.032165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.032462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.033924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.045851 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 290/579] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.048667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423941c-90c7-44b7-adcb-6a62c726f0b3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.051639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.088817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.088817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.088817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.089297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.089695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.090094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.100860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.100860 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 290/580] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.100860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.153280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.158165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.184799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f8cde-b3ec-4ad3-a704-dc8f15f2466b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.208672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e1fb-3e08-405d-8786-085d557ae38e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.230279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.231731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.232450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.232968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] PATH_INFO: `/v3/services/network` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.234373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.236905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.245377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.245976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.246244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.246504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.247218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=3741f090453c44c2b2d2d2b41af8330d) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.247518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:48.248797 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:48.249913 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:48.250799 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:48.251573 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.253858 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 291/581] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:48.254907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.269259 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 291/582] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/role_assignments?user.id=3741f090453c44c2b2d2d2b41af8330d&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.269259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.451126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa05eec-199d-4341-814b-0ea10e05c1ac None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.455810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046da0f-0212-4211-b6ee-dfe3ea87c319 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.494196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.494713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.494989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.495249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.495895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.496173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.497749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.500492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.502962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.505901 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 292/583] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.511849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.541735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.543267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.543779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.544219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.545075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.545563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.548007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.555612 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 292/584] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.562217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.636943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c3d7c-076f-4910-a934-4ab0ff8525c1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.671764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.672381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.672654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.672960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.673697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] RBAC: Adding query filter params (interface=public, service_id=69708b7f2b0c47508091624bf9466956, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.673974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.675359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.686503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6734719-a2c6-4072-8716-9a5f22dbadd8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.687617 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 293/585] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/endpoints?service_id=69708b7f2b0c47508091624bf9466956&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.688828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.724208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.725318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.725776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.726196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.727063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.727555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.729230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.736008 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 293/586] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:48.742160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.788905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.813586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:48.853849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e68121-6312-41d9-bda5-be3b4d942bd8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.890546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.891517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.891984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.892461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.893401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] RBAC: Adding query filter params (interface=public, service_id=ed6f44d4d61d46e2ac2f8d5ce2fbb246, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:48.893916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.895613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.897892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554c33e-0fcb-4dfe-b095-4e0ee3519cea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:48.904216 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 294/587] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/endpoints?service_id=ed6f44d4d61d46e2ac2f8d5ce2fbb246&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:48.910043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:48.938495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:48.939362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:48.939362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:48.939634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:48.940228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:48.941652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0cbe4-e6d9-468f-a033-885fb69d3534 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:48.953003 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 294/588] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:49.027313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395e57-0ac0-48b5-95ad-a939cbc3513a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.030211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.065798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.067267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.067739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.068200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.069050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:49.070860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905b4d3-8510-45fd-8b00-785fcf89d057 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:49.077753 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 295/589] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:43:48 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:49.308594 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88ccf-d54e-441d-b60e-7695afe5975e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.309142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88ccf-d54e-441d-b60e-7695afe5975e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.309142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88ccf-d54e-441d-b60e-7695afe5975e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.310668 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 295/590] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:49.316704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acb4c-f36b-4ce5-9f2f-b362d0191fa1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.316963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acb4c-f36b-4ce5-9f2f-b362d0191fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.317211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956acb4c-f36b-4ce5-9f2f-b362d0191fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.338593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-956acb4c-f36b-4ce5-9f2f-b362d0191fa1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:49.339787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-956acb4c-f36b-4ce5-9f2f-b362d0191fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:49.422152 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 296/591] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:49.507567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ad45-391a-4527-9e00-7d8c28099209 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.507895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ad45-391a-4527-9e00-7d8c28099209 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.508109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430ad45-391a-4527-9e00-7d8c28099209 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.509752 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 296/592] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:49.515235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.515517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.515780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.534289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:49.535473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:49.607177 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 297/593] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:49.775618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430ad45-391a-4527-9e00-7d8c28099209 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:49.904609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430ad45-391a-4527-9e00-7d8c28099209 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:49.937410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:49.949413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:49.950279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:49.950738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:49.951193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:49.966944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:49.972008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:49.972941 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:49.974174 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 297/594] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:49.979374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.029247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.106137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf119d-0310-411a-8e1f-14fe78d538db None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.125353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.167135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.167656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.167927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.168191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.170356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:50.170656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.172192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.189011 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 298/595] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:50.195036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.319417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abab5a4-524c-40e4-afae-552006038c9d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.358017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.376787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721207d-da58-45f8-ad9d-ff9a0080be26 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.387652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.388288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.388561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.388827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.406199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:50.414326 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:50.415262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:50.416986 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 298/596] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:50.421198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.456160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.457082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.457521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.457932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.472154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.478802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.480445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:50.506747 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:50.507746 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:50.508967 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:50.508967 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:50.508967 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:50.508967 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 299/597] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:50.514593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.590851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6fffa4-0f79-45d6-92bf-92300460d4e8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.630232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781fc4-709a-4310-afe6-33bbfacb2292 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.674317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.674851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.675127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.675397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.676069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:50.676369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.677802 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.700868 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 299/598] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:50.708319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.718564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.719205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.719484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.719759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.720415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:50.720716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.722128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.751069 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 300/599] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:50.756431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:50.759956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.884579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f7b3-dda4-4b15-835a-805df50b79cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.894273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:50.912625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb463d5-f18a-4d38-b3ce-98c2cfa373a2 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:50.935600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.936152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.936427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.936729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.954724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:50.956194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:50.983121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:50.984404 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:50.985349 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:50.985349 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:50.985349 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:50.985349 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 300/600] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:50.990010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:50.990674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:50.990949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:50.991220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:50.996410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.005242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.006748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:51.029156 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:51.030186 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:51.031222 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 301/601] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:51.041846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.154201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.178350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265573-c09e-4d41-bde3-336dad4fee67 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.206830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73250a-9e3c-44bc-88bf-e461f652314c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.222055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.223379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.224058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.224505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.225585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:51.226034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.227930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f3299-1cb4-4e97-bcc0-e40f9df412dd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.245087 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 301/602] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:51.245700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.246410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.246778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.247117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c1e8-1ff2-40ae-8281-cf2f23ff3d65 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.247231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.247651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c1e8-1ff2-40ae-8281-cf2f23ff3d65 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.248061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899c1e8-1ff2-40ae-8281-cf2f23ff3d65 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.248179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:51.248568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.250124 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 302/603] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:51.250956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c1e8-1ff2-40ae-8281-cf2f23ff3d65 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.252972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dfcb2-9d22-43a9-b4bd-d2aa799b4993 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.275595 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 302/604] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:51.280974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.280974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.280974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.282184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.308342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:51.310012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:51.365027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899c1e8-1ff2-40ae-8281-cf2f23ff3d65 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.394505 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 303/605] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:51.395856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.415078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.415778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.416052 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.416318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.434012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.435586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:51.453095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:51.454132 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:51.455091 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 303/606] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:51.460324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.462292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.523891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4750b8-40a7-40dc-8945-c443a5679bbf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.565266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.566809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.567313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.567807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.572599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.593826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5a25-5a4f-4e5f-b836-8795842a40ce None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.636804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.637983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.638224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.638532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.639499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:51.639895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.640100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.641354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bbb16a-9903-4d92-a660-e064456b9840 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.641561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3d86a-4bdd-4790-8f4e-6a442787c075 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.666517 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 304/607] 10.222.0.13 () {56 vars in 1135 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:51.668045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febceaa-d3e8-461e-8f6f-4ab50d632bda None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.668429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febceaa-d3e8-461e-8f6f-4ab50d632bda None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.668699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febceaa-d3e8-461e-8f6f-4ab50d632bda None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.670148 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 305/608] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:51.671180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86366f5-c549-4075-860b-2f529b88d33d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.671552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86366f5-c549-4075-860b-2f529b88d33d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.671823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86366f5-c549-4075-860b-2f529b88d33d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.677234 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 306/609] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:51.678070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86366f5-c549-4075-860b-2f529b88d33d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.694777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.751710 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 304/610] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:43:51.751710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae64b83-e8a1-410b-adc6-db083e0cbe0e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.751710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae64b83-e8a1-410b-adc6-db083e0cbe0e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.751710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae64b83-e8a1-410b-adc6-db083e0cbe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.767260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-eae64b83-e8a1-410b-adc6-db083e0cbe0e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:51.768463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eae64b83-e8a1-410b-adc6-db083e0cbe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:51.782722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86366f5-c549-4075-860b-2f529b88d33d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:51.816448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:51.817081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.817353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.817623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.825856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:51.833677 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 305/611] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:51.834937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:51.835224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:51.835493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:51.852795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:51.854105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:51.894098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:51.895541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:51.936583 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 306/612] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:51.936583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:51.937596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.025909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c0e24-6a91-42f1-bded-d0a24316943a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.029003 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 307/613] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:43:52.030070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.064078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.064710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.065016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.065276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.065851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.067355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.076236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.077281 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.078188 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 307/614] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 16 00:43:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.079000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.079897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.143203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5517a04-fcb2-45ba-865e-ccefe0f3e193 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.158799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.181288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.182111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.182597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.182866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.185170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f32c1-4691-471e-9898-6f8bd24fae6a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.193215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.194683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:52.210138 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.211140 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:52.212032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:52.212032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:52.212032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:52.212032 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 308/615] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.212032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.224401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.225082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.225357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.225621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.237803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.239268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:52.253401 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.254528 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:52.255419 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:52.255419 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:52.255419 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.255419 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 308/616] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.255653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.303380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.312732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250553b-f06d-4ea7-b4c7-73bc109b0a2a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.344410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.345045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.345319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.345586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.346207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.346503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.347877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.351819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bd571-0b98-4874-ba2f-5b5ae815e6bf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.352293 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 309/617] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.353092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.377673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.386757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.387404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.387663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.387930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.388508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.390105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.398788 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.399760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.400673 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 309/618] 10.222.0.13 () {56 vars in 1129 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.401544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.455169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d5bae-5c4a-4478-9d2c-cd02ccdb3097 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.488033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.488627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.488928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.489196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.489826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.490121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.491491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.499197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe22c6d-973f-4f28-aa47-6ef8146dbc26 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.503052 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 310/619] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.503855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.518620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.534152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.534927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.535220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.535472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] PATH_INFO: `/v3/services/network` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.536049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.537453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.546108 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.547069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.547927 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 310/620] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services/network => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.548738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.601764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ac8ab-d082-40fc-a752-d87972044849 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.602286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.635090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.635676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.636021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.636213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.636869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.637190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.638571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.648324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de2e65-8fd3-40c0-893a-c8767a2f8aab None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.649679 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 311/621] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.650252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.685619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.686229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.686503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.686852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.687474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.687775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.689183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.693648 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 311/622] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.697932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.724983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.751915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa23402-3ae8-44ab-8d1f-37df0925312c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.789805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.790399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.790668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.790936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.791606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.791907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.793366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.798548 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 312/623] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.799633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.822620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df4f60-f9c4-4e9c-a32d-ab35ba5415b1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.841548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.861037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.861588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.861865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.862131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.870102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.871238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:52.883428 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:52.884520 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:52.885530 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 312/624] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:52.886043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.916165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d357d-6a4c-4f5f-85d3-e62083fec073 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:52.957652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:52.958278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:52.958550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:52.958799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:52.959472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] RBAC: Adding query filter params (name=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:52.959744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:52.961176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:52.965794 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 313/625] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:52.969694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:52.973037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:52.994861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edd60f-5859-4818-90ef-3a1d5af96c74 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.032424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.033459 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.033977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.034336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.041520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.042987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:53.054525 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:53.055498 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:53.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 313/626] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:53.057866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.080303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f656c2-5619-4aea-93ce-9f54d23c989b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.101889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.120295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.120824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.121123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.121385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.122013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.122308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.123680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.133026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 314/627] 10.222.0.13 () {56 vars in 1124 bytes} [Sun Oct 16 00:43:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.133026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.175990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbef1be-3ad2-4773-b8cd-2c8b89fcd6cf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.198484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.213298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.214047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.214439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.214795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.215657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.216047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.217605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.229941 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 314/628] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.230669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.239562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca23d9-afbc-46d4-97b9-588bcbad1b05 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.274373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.275227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.275914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.276638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.277444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] RBAC: Adding query filter params (type=network) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.278042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.280285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.286887 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 315/629] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.288130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.326831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.332121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246dc3-4b37-4f18-b306-379f004b4e44 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.367967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.368846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.369134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.369529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.370228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.370605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.372012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.389835 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 315/630] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.389835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.403343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ae667-8bd9-4fe4-9fa6-2b1644de5d3b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.439053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.446316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.446997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.447360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.447670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.448395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.449902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.484875 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 316/631] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:43:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:53.484875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.498849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887edd3f-a3cc-40c0-beaa-adfd89514556 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.552029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22795307-f902-4102-a091-d563614e0dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.552653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22795307-f902-4102-a091-d563614e0dcd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.552955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22795307-f902-4102-a091-d563614e0dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.553223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22795307-f902-4102-a091-d563614e0dcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.554149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22795307-f902-4102-a091-d563614e0dcd None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=270eef82009744d8b43e43c86514e519) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.554501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22795307-f902-4102-a091-d563614e0dcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.556150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22795307-f902-4102-a091-d563614e0dcd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.563345 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 316/632] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/role_assignments?user.id=270eef82009744d8b43e43c86514e519&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:53.564345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22795307-f902-4102-a091-d563614e0dcd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:53.607685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:53.688147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298765f-5352-497b-b355-cf5401bc5997 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.733361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.734066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.734373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.734632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.735307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.737121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08679f52-9ad0-4d86-b678-d4375177fb53 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.753506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22795307-f902-4102-a091-d563614e0dcd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:53.762375 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 317/633] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:43:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:53.814647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:53.815354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:53.815728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:53.816052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:53.816946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=5fdb324c26934b11b3c4fe8dff574d88) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:53.817271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:53.818813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5abc-f009-43da-8781-6bf2cd802651 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:53.826631 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 317/634] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:43:53 2022] GET /identity/v3/role_assignments?user.id=5fdb324c26934b11b3c4fe8dff574d88&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:54.897877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4701-448c-41b8-ab5b-4cafdb6c06f4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:54.898465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4701-448c-41b8-ab5b-4cafdb6c06f4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:54.898465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4701-448c-41b8-ab5b-4cafdb6c06f4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:54.899922 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 318/635] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:54.905514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c768b-f347-489c-ae56-4b4d3dfe84c3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:54.906333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c768b-f347-489c-ae56-4b4d3dfe84c3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:54.906832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c768b-f347-489c-ae56-4b4d3dfe84c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:54.925531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-460c768b-f347-489c-ae56-4b4d3dfe84c3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:54.927143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-460c768b-f347-489c-ae56-4b4d3dfe84c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:54.993556 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 318/636] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:55.261310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e4701-448c-41b8-ab5b-4cafdb6c06f4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:55.306285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:55.367429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e4701-448c-41b8-ab5b-4cafdb6c06f4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:55.403258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:55.404310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:55.404815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:55.405359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:55.406217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:55.407909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bc948-b7ff-44fe-88e4-2cc2cce87643 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:55.424918 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 319/637] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:55 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:55.879660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a4-252f-4d60-8640-0576fd9c2015 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:55.880083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a4-252f-4d60-8640-0576fd9c2015 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:55.880201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7c5a4-252f-4d60-8640-0576fd9c2015 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:55.881929 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 319/638] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:55.887411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1547-f563-417f-80e6-4d43109a7ce7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:55.887660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1547-f563-417f-80e6-4d43109a7ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:55.887928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb1547-f563-417f-80e6-4d43109a7ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:55.909024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9ceb1547-f563-417f-80e6-4d43109a7ce7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:55.910265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9ceb1547-f563-417f-80e6-4d43109a7ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:55.994549 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 320/639] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:56.038575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114c77-d6a3-467f-9371-8f78fd2417f9 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.039137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114c77-d6a3-467f-9371-8f78fd2417f9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.039137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57114c77-d6a3-467f-9371-8f78fd2417f9 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.040579 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 320/640] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:56.046280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.046841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.047325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.066800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:56.068429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:56.074234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d08-c710-46b1-8b56-97d8c3cb5579 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.074520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d08-c710-46b1-8b56-97d8c3cb5579 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.074790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18731d08-c710-46b1-8b56-97d8c3cb5579 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.076358 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 321/641] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:56.081710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.082292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.082772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.093386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.108619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:56.110227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:56.124997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.143578 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 321/642] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:56.192941 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 322/643] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:56.274899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.380375 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9234920-20f5-4a2b-b476-c32c4a62def3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.415070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.415637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.415904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.416173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.416750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.418154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:56.426830 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:56.427881 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.428790 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 322/644] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:56.429697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.436114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.463702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.541304 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978652a-23e3-4331-b45e-ab9dce025b74 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.544664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f263963-e0ab-4f45-8c7b-72eb876908e0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.574286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.574898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.575175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.575443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.576089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:56.576387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.577805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.582304 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 323/645] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:56.582762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.583445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.583570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.583855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.584174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.594032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.599355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:43:56.604348 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:56.605374 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 323/646] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:56.606235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.680517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.696787 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84dfa8-a8ed-4b9a-8c27-5c5609f571fb None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.711991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd167-87f1-475a-a081-27734491ee12 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.732812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.733497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.733770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.734033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.734610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.736350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:56.745220 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:56.746438 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:56.747297 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 324/647] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:56.748104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.755658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.756280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.756556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.756851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.757488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:56.757784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.759158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.764044 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 324/648] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:56.764714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.834287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:56.879170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81cd45-aaf1-45c7-a06e-2955a4519cf7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.895892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510ee6-bea7-4d49-b7eb-195dea737ead None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:56.920543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.921817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.922652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.923089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.923880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:56.924334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.926723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.933881 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 325/649] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:56.942645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.947658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:56.948271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:56.948541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:56.948801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:56.949493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:56.949795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:56.951168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:56.961469 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 325/650] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:56.966976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:56.984432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.058818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147ac6-53ea-4005-b8d1-8d0838cfa7df None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.087765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.089098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d559a2-0f1e-4296-ae65-6ef1e13717fe None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.098708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.099606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.100031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.100446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.101244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:57.101729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.103246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.109568 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 326/651] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:57.133272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.134234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.134657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.135066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.147622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.149570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:57.165646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:57.166905 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:57.168008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:57.168008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:57.168008 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:57.170390 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 326/652] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:57.178085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.291950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e381938-ce39-4e37-b614-f03e09500ae6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.331355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.331963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.332240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.332471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.333170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:57.333460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.334820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.346869 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 327/653] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:57.352369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.419789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.458865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc81ea-eff8-4552-bf73-7658fc1f0344 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.493508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.494137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.494407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.494672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.502620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.504075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-e14a3eb0-3ad2-424c-a260-5a04dbb8c979 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:43:57.515325 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:57.516299 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:57.517283 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 327/654] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:57.524735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.583088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.639749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23946-82f1-430d-a550-350b2b15adcc None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.653710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b680-1243-4e9e-9d9e-cde888fc9002 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.654157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b680-1243-4e9e-9d9e-cde888fc9002 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.654433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015b680-1243-4e9e-9d9e-cde888fc9002 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.656920 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 328/655] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:43:57.662702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.662983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.663263 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.679428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.680039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.680315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.680580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.681355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:57.681656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.683094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.686432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:57.687672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:57.701616 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 328/656] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:57.710037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.776007 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 329/657] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:43:57.835536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2abd9-130f-46cf-940e-4a11d04ffd2c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:57.845712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:57.871524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:57.872155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:57.872423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:57.872685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:57.882892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:57.884348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:43:57.899191 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:57.900144 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:43:57.901072 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:43:57.901072 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:43:57.901072 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:57.901072 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 329/658] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:57.907751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:57.963669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.011637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24808f08-b215-4fc9-8169-aceb5b679198 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.046472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.047426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.048223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.048694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.049548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.050126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.051691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.065114 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 330/659] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:58.069295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.072258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.178138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea027ac-87f0-4141-ac7e-c39ea74ef558 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.188734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5148b2-1f5c-4a59-9bae-b8cd56890da5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.202632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.219546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.220493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.220949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.221359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.222070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.223870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.225483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.226206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.226589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.226949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.234129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:58.234760 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:58.236203 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:43:58.237327 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:43:58.238811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.244646 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 330/660] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:43:58.245986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:43:58.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:43:58.252169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:43:58.253310 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:43:58.259563 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 331/661] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:43:58.260487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.285467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.413592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3073240-62ff-4765-819d-e5c87a187796 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.423260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369f33a-1a00-47d6-87bb-24372d30b08f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.470770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.472193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.473518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.474081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.475570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.476328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.479268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.481749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.482963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.483597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.484154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.485985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.486536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.490500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.494897 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 331/662] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:58.498933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.517107 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 332/663] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:58.521887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.578410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.632981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.645603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682080b-c1ce-4e71-9456-845d7d279f9d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.669833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a804130-c8a4-4442-8474-007c025f6f2b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.681858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.682513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.682734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.682995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.683617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.683907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.685307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.695859 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 332/664] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:43:58.697642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.708287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.709343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.710151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.710617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/270eef82009744d8b43e43c86514e519/roles/08eae8aaf7a549a49ed2f9dc8dc09220` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.713116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=270eef82009744d8b43e43c86514e519, role_id=08eae8aaf7a549a49ed2f9dc8dc09220)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.714984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.730778 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 333/665] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:43:58 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/270eef82009744d8b43e43c86514e519/roles/08eae8aaf7a549a49ed2f9dc8dc09220 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:43:58.808824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdba0-25af-4890-8fdc-2337da93a308 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:58.846627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:58.847242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:58.847511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:58.847770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:58.848480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] RBAC: Adding query filter params (interface=public, service_id=f1e2e181009a4d149185d9434e3e914a, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:43:58.848776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:58.850191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd84d92-e43d-4e5f-b582-d60ba0fc9b84 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:58.860900 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 333/666] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/endpoints?service_id=f1e2e181009a4d149185d9434e3e914a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:43:58.866007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:58.973832 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:58.980608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381ccfb-ba5f-4153-a85a-fb2816a925fd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:59.016230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:59.016859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.017128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.017392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.017986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:59.019415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d968c-2554-42dc-8270-dea8d294684f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:59.027979 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 334/667] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:43:58 2022] GET /identity/v3/services => generated 1029 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:43:59.030648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a122-a98d-42c7-8434-f463d15638a2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.030933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a122-a98d-42c7-8434-f463d15638a2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.031205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a122-a98d-42c7-8434-f463d15638a2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.032946 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 334/668] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:59.039060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dac6-50f3-483e-8e7a-1aacd81cb8a0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.039393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dac6-50f3-483e-8e7a-1aacd81cb8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.039595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084dac6-50f3-483e-8e7a-1aacd81cb8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.059925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7084dac6-50f3-483e-8e7a-1aacd81cb8a0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:59.061220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7084dac6-50f3-483e-8e7a-1aacd81cb8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:59.139579 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 335/669] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:59.347282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c8f7-f623-42a7-a42e-a58b556ed746 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.347817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c8f7-f623-42a7-a42e-a58b556ed746 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.347817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c8f7-f623-42a7-a42e-a58b556ed746 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.349465 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 335/670] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:43:59.354697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.354987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.355261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.374725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:43:59.375942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:43:59.408113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0c8f7-f623-42a7-a42e-a58b556ed746 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:59.430241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:59.451939 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 336/671] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:43:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:43:59.536109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0c8f7-f623-42a7-a42e-a58b556ed746 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:59.575344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:59.576005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.576285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.576555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.577283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:59.578677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108269-f3dd-4c6a-a82c-63b5cd5334b5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:59.598777 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 336/672] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:59 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:43:59.739994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:43:59.760181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:43:59.847898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260c956-40c9-43b5-8ea1-e5555dae2cb7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:43:59.889340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:43:59.889874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:43:59.890149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:43:59.890416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:43:59.891062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:43:59.892499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a28dc-68ad-4eed-b542-26b519bfd843 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:43:59.909449 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 337/673] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:43:59 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:00.956031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe420-a91a-4a8e-ad34-c3ae8d188587 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:00.956621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe420-a91a-4a8e-ad34-c3ae8d188587 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:00.956621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfe420-a91a-4a8e-ad34-c3ae8d188587 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:00.958182 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 337/674] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:00.963800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22928de-1b8c-4472-8ece-52467807c20e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:00.964682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22928de-1b8c-4472-8ece-52467807c20e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:00.965182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22928de-1b8c-4472-8ece-52467807c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:00.983428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f22928de-1b8c-4472-8ece-52467807c20e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:00.984917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f22928de-1b8c-4472-8ece-52467807c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:01.053566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:01.059845 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 338/675] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:01.237441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a17a-ba50-48d3-9815-0af28a6d1a5c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.238075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a17a-ba50-48d3-9815-0af28a6d1a5c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.238554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321a17a-ba50-48d3-9815-0af28a6d1a5c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.240373 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 338/676] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:01.245472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395396da-63d3-40da-a676-a559f634ba37 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.245994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395396da-63d3-40da-a676-a559f634ba37 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.246498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395396da-63d3-40da-a676-a559f634ba37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.265661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-395396da-63d3-40da-a676-a559f634ba37 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:01.267145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-395396da-63d3-40da-a676-a559f634ba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:01.322059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321a17a-ba50-48d3-9815-0af28a6d1a5c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.338765 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 339/677] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:01.417757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:01.425424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321a17a-ba50-48d3-9815-0af28a6d1a5c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.461006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:01.461697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.461971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.462236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.473476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:01.478497 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:01.479461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:01.480310 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:01.484965 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 339/678] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:01.486768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395396da-63d3-40da-a676-a559f634ba37 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.590490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395396da-63d3-40da-a676-a559f634ba37 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.614952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.620458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:01.627799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:01.628508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.628784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.629073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.629740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:01.630037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:01.631542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:01.640715 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 340/679] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:01.647076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.728296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc043b0f-1a1b-418c-9804-533034c1e9f6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.767430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:01.768136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.768416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.768688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.769502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:01.771023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:01.774558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:01.780588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddef561-02e4-4c24-95a0-0809c84ada63 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:01.782255 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:01.783342 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 16 00:44:01.784438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:01.786743 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 340/680] 10.222.0.13 () {56 vars in 1132 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:01.793971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.824902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:01.825685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.826268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.826607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.840667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:01.842683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:01.863123 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:01.864301 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:01.865517 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:01.865517 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:01.865517 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:01.870738 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 341/681] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:01.871630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:01.917258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:01.918774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d82a-e261-4f08-931f-8bdf2e662979 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.959482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:01.960123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.960326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.960586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.961323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:01.961616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:01.962975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2a739-9a25-444b-ae9a-a67213f67e95 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:01.972560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca77b2-4b07-45e6-bc09-5a8a2de3f92f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:01.973357 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 341/682] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:01.974514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b6-65ce-4283-9544-cd6c380bb6f8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:01.974792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b6-65ce-4283-9544-cd6c380bb6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:01.975789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753660b6-65ce-4283-9544-cd6c380bb6f8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:01.980495 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 342/683] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:01.980495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753660b6-65ce-4283-9544-cd6c380bb6f8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.008581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.009244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.009720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.009861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.010395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:02.010723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.012059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cec871-cfbe-4f9e-9ddc-c86a2c259632 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.028358 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 342/684] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:02.028358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.028358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.028358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.044571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:02.046145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:02.053974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.103588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753660b6-65ce-4283-9544-cd6c380bb6f8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.140862 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 343/685] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:02.140862 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.141136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.141136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.141136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.141136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.141462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:02.141462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.142355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.147654 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 343/686] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:02.153060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.177843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.251621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55fd7b-b3e9-43f5-8aa8-c1254ebd45d7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.255603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993ef3-192a-4f75-851d-0dd91a9bf508 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.286421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.287071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.287345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.287799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.288708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.295310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.296812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.297211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.297776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.298050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.298316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.298978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.300333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a22e9b-a208-41a1-9ee3-91723470f4a7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-a99ae1b6-1576-4957-971e-3ba38d84d052 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:02.308303 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:02.309262 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:02.310202 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 344/687] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:02.315579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ad6e-1e00-4fd6-9230-73f2eeaffae5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.315900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ad6e-1e00-4fd6-9230-73f2eeaffae5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.316134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ad6e-1e00-4fd6-9230-73f2eeaffae5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.320954 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 345/688] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:02.320954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ad6e-1e00-4fd6-9230-73f2eeaffae5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.336864 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 344/689] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:02.336864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.336864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.336864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.355477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:02.357420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:02.444094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.453168 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 345/690] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:02.453365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ad6e-1e00-4fd6-9230-73f2eeaffae5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.454034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.493315 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.493981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.494259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.494528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.495273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:02.495575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.497105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.517736 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 346/691] 10.222.0.13 () {56 vars in 1149 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:02.523092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.591617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b2005-4890-4491-96a4-6e43e4edca5b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.603118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.634571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.635133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.635409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.635674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.636249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.639214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.650391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d80a33-3a39-4ee4-a9e7-d5c2db100a59 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:02.654734 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:02.656326 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:02.657188 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.660618 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 346/692] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:02.669001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.691158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.691755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.692034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.692303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.717945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.766452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.768271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.781067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9d758-da73-4ffe-8ad4-ce4abc6543c5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.815993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.816602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.816898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.817170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.817816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:02.818096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.819473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.824055 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 347/693] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:02.824055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.864280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.878526 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 347/694] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 16 00:44:02.883006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:02.929804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:02.932090 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d392ac4-e30c-4f25-bc2d-bd287b6c9618 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.966281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:02.966969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:02.967237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:02.967492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:02.968073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:02.969691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:02.979201 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:02.980231 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:02.986620 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:02.987356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff13211-9ecc-431a-bbb4-5276c3688a0c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:02.987775 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 348/695] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:02.987775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.020286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.020897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.021177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.021437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.022045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.022339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.023701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.028434 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 348/696] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.029240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.100403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af6665-e843-401c-bc11-2ca23ee1a144 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.102211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.136801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720fc00-e83f-4be7-8e3f-284aa586c28c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.137542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.138177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.138448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.138713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.149992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.151639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.155384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:03.167984 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:03.169010 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:03.169954 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:03.169954 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:03.169954 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:03.169954 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 349/697] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:03.170192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.179272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.179942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.180162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.180416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.181065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.181356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.182741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.188107 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 349/698] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.189173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.280644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152fb53-bcbf-467e-b298-90219cbafe1e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.294618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd4fb-2646-421a-a4c1-ee37d8b89b99 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.316205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.316813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.317113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.317376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.318075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] RBAC: Adding query filter params (interface=public, service_id=ee979f2a9f7c4241a7aedfec6ca3d111, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.318374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.319849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.325019 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 350/699] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/endpoints?service_id=ee979f2a9f7c4241a7aedfec6ca3d111&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.325795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.333049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.333657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.333926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.334188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.334826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.335117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.336494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.346232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.353158 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 350/700] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.353158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.388906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.439859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967472-7b1d-491c-b432-618a75a0825a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.442694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d918b2-896d-422f-b568-da508c96b25f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.474249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.474895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.475177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.475277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.475445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.475825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.476043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.476227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.476387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.476479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.476948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.477735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.478306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.488148 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 351/701] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.488148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.488387 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 351/702] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/services => generated 1497 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:44:03.497556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.589346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.613477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877ada6-eee0-42c3-b252-40bc2e0f3d46 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.618364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848e2-bae9-4353-8c4d-d83fb9ad4423 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.621502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.654957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.656048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.656563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.657125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.659111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.659851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.660132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.660403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.661162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] RBAC: Adding query filter params (interface=public, service_id=62fb0ee477634b17b4d3b914df8f98f8, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.661786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.663161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.666867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.668577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.672999 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 352/703] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/endpoints?service_id=62fb0ee477634b17b4d3b914df8f98f8&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.674935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:03.688616 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:03.689768 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:03.690906 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 352/704] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:03.699274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.789935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67a98e-588f-4c7a-988a-6913844f4191 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.807733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395fe0a-af20-4b17-a19e-c9987669a1fd None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:03.829497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.830414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.830887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.831381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.832260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.833885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.845138 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 353/705] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:44:03.848948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:03.848948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:03.848948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:03.848948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:03.849327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:03.849327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:03.850561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dd1c7-3ee8-4d38-add5-ec2ed428582c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:03.865765 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 353/706] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:03.872106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:03.911543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:03.989438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362f154-ed07-4d4d-ad0d-f037b1f9642b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:04.027443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:04.028073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.028338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.028602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.029366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] RBAC: Adding query filter params (role.id=08eae8aaf7a549a49ed2f9dc8dc09220, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=270eef82009744d8b43e43c86514e519) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:04.029682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:04.031186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaaada-2afa-49e0-a4d7-5b2fd72d8063 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:04.038196 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 354/707] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:03 2022] GET /identity/v3/role_assignments?user.id=270eef82009744d8b43e43c86514e519&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=08eae8aaf7a549a49ed2f9dc8dc09220 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:04.563260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e2a9-abfd-4b50-98ff-150185d8843e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.563839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e2a9-abfd-4b50-98ff-150185d8843e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.563839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1e2a9-abfd-4b50-98ff-150185d8843e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.565393 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 354/708] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:04.570922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:04.571206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:04.571475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:04.589889 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:04.591069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:04.659759 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 355/709] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:04.923693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1e2a9-abfd-4b50-98ff-150185d8843e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:04.927371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:05.030692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1e2a9-abfd-4b50-98ff-150185d8843e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.065674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.066297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.066571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.066839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.067414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.068869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:05.077881 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:05.078901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:05.079778 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 355/710] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:05.088773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.121793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:05.195759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3727-00d2-49f7-8d48-d3d61e0a074b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.230064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.230672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.230946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.231209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.231834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:05.232128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.233586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf3274-997a-4921-b550-9c2ed438f7aa None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.239203 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 356/711] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.245042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:05.313975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:05.350185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ee7ee-1432-4fea-9ce8-314b4e9c9ea8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:05.384959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:05.385568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.385841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.386151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.386779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:05.387074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:05.388432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bacdf4-7490-4fb9-8098-8e7dec8bf702 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:05.393293 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 356/712] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:05.736287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817296-84b6-4188-9133-50024002cca2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.736669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817296-84b6-4188-9133-50024002cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.736894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817296-84b6-4188-9133-50024002cca2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.738547 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 357/713] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:05.744072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be5fe-6d56-40fe-8f39-645413cbb44e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:05.744605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be5fe-6d56-40fe-8f39-645413cbb44e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:05.744778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871be5fe-6d56-40fe-8f39-645413cbb44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:05.764115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-871be5fe-6d56-40fe-8f39-645413cbb44e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:05.765359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-871be5fe-6d56-40fe-8f39-645413cbb44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:05.834111 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 357/714] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:06.098105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817296-84b6-4188-9133-50024002cca2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.104414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198aa2-2760-438c-ad56-e70252fd94ec None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.104414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198aa2-2760-438c-ad56-e70252fd94ec None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.104414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db198aa2-2760-438c-ad56-e70252fd94ec None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.104414 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 358/715] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:06.114580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498695-0d40-428e-b548-3e56626cced6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.114580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498695-0d40-428e-b548-3e56626cced6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.114580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498695-0d40-428e-b548-3e56626cced6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.133443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b7498695-0d40-428e-b548-3e56626cced6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:06.135418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b7498695-0d40-428e-b548-3e56626cced6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:06.199868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.200555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.212741 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 359/716] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:06.213206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817296-84b6-4188-9133-50024002cca2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.214877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf5-6ca6-4310-b7c7-b0b5e8a86341 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.216246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf5-6ca6-4310-b7c7-b0b5e8a86341 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.216720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411bf5-6ca6-4310-b7c7-b0b5e8a86341 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.223090 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 360/717] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:06.224937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.225438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.226305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.248312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:06.249664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:06.261443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.262613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.263081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.263784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.265058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.267184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:06.279923 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:06.280938 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 16 00:44:06.281777 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.283407 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 358/718] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:06.288470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.337308 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 361/719] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:06.393804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a5e27-0d57-4af4-b4b6-bf0ba933ecc3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.426938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.427538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.427806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.428069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.428685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:06.429007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.430385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.435270 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 359/720] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:06.441104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.486657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.507487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.552396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a0af5-c502-43b6-866a-9ea8b79be9e4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.574195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.589448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.590603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.590888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.591156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.591910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:06.592359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.593756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.599323 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 362/721] 10.222.0.13 () {56 vars in 1114 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:06.605126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.607487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef308d1-5698-4d93-84fc-a64d950335e9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.645265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.645893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.646163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.646425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.647034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.648795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:06.658432 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:06.659440 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.660322 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 360/722] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:06.661835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.718747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718b855-44f7-49b6-9d34-34de9af22a2d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.747474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.754613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.755529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.755529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.755741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.756363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.757758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.767424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6749f1-d582-4726-a356-afad1e5695b2 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.778255 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 363/723] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:06.779322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.822687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.823362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.823804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.824075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] PATH_INFO: `/v3/services/image` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.824668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.826300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:06.836561 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:06.837690 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:06.838547 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:06.843122 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 361/724] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:06.844590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:06.848755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:06.935558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf4da-1a1e-4c7b-9fcc-f61dae582988 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.956621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a2e29-f768-449a-8291-2fbcf24d000a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:06.984827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.986578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.987165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.987597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.988563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:06.989128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.990802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:06.995714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:06.996427 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 364/725] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:06.996534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:06.997034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:06.997435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:06.998072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:06.998440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:06.999812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:07.002344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:07.005362 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 362/726] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:07.011010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:07.020261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:07.122960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ab49e-7ae9-4bf5-bad2-cc64fb7aed96 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:07.126909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:07.132946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154526-08d2-4721-93db-a9aeeff491e6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:07.164998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:07.165613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.165880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.166143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.166758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:07.167046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:07.168416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:07.174102 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 365/727] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:07.179903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:07.186465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:07.187079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.187350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.187677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.188307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] RBAC: Adding query filter params (type=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:07.188661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:07.190065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c4cae-6d04-4f9e-8f9d-b91ac462f21d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:07.196928 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 363/728] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:07.299273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9a74e-95ed-45bd-9594-80f97d2e51e1 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:07.336799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:07.337844 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.338318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.338796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.339673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:07.341354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0613a39-dcaf-4094-88ae-db8fb812863c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:07.367460 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 366/729] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:07.591511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b9d44-8896-4411-af64-99ac093c1a6e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.591928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b9d44-8896-4411-af64-99ac093c1a6e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.592145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b9d44-8896-4411-af64-99ac093c1a6e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.594655 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 364/730] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:07.608565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe52cd6-4b0d-41b9-a6cb-3e282f71f906 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:07.609194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe52cd6-4b0d-41b9-a6cb-3e282f71f906 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:07.609663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe52cd6-4b0d-41b9-a6cb-3e282f71f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:07.629995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-dfe52cd6-4b0d-41b9-a6cb-3e282f71f906 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:07.631560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dfe52cd6-4b0d-41b9-a6cb-3e282f71f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:07.651096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:07.708848 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 367/731] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:07.973424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b9d44-8896-4411-af64-99ac093c1a6e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:08.044016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:08.075729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b9d44-8896-4411-af64-99ac093c1a6e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:08.109758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:08.110830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:08.111110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:08.111367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:08.112075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:08.113493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae6a05-66de-487f-9a3d-8c9a6d870404 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:08.133458 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 365/732] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:07 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:09.065039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2b75-41e6-489e-84a4-60ba3a6cff0f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.065609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2b75-41e6-489e-84a4-60ba3a6cff0f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.065609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b2b75-41e6-489e-84a4-60ba3a6cff0f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.067248 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 368/733] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:09.072492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a3b9-75a0-4e78-8b8e-eda22646c4ae None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.072776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a3b9-75a0-4e78-8b8e-eda22646c4ae None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.073080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964a3b9-75a0-4e78-8b8e-eda22646c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.095511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8964a3b9-75a0-4e78-8b8e-eda22646c4ae None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:09.096683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8964a3b9-75a0-4e78-8b8e-eda22646c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:09.170812 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 366/734] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:09.399725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da101-c0e9-41dc-bbdf-0060a140f620 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.400395 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da101-c0e9-41dc-bbdf-0060a140f620 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.400914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da101-c0e9-41dc-bbdf-0060a140f620 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.402726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 369/735] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:09.408367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.408643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.409181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.435177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:09.437114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356da101-c0e9-41dc-bbdf-0060a140f620 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.437359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:09.505466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.531676 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 367/736] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:09.568468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356da101-c0e9-41dc-bbdf-0060a140f620 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.604467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.605383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.605858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.606301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.607112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.608808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.612088 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING keystone.server.flask.common [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 16 00:44:09.631518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.sql.core [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:09.631518 dv-cinder-master-3-smb devstack@keystone.service[81465]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:09.631518 dv-cinder-master-3-smb devstack@keystone.service[81465]: [parameters: {'id': 'c480d4b16d2d4a15a102e0a9b6c8951e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:44:09.631518 dv-cinder-master-3-smb devstack@keystone.service[81465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-f4703734-dd14-4e31-9d5a-40ed77475319 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c480d4b16d2d4a15a102e0a9b6c8951e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c480d4b16d2d4a15a102e0a9b6c8951e. Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:09.640599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:44:09.641565 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application yield resource Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise self.value Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application session.commit() Oct 16 00:44:09.642777 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:44:09.643894 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:44:09.644978 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:09.645783 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [parameters: {'id': 'c480d4b16d2d4a15a102e0a9b6c8951e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.646662 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:09.647458 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c480d4b16d2d4a15a102e0a9b6c8951e. Oct 16 00:44:09.648438 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:09.650686 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 370/737] 10.222.0.13 () {60 vars in 1140 bytes} [Sun Oct 16 00:44:09 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:09.661981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.664873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5329f-4ca8-46e5-b061-4367db79fb9b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.664873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5329f-4ca8-46e5-b061-4367db79fb9b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.664873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5329f-4ca8-46e5-b061-4367db79fb9b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.669896 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 371/738] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:09.675514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.675797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.676085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.691331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.698164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:09.699540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:09.778564 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 372/739] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:09.797150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce04fc-54ce-46a2-94d7-1923a956adf4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.823651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.834734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.835042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.835282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.835539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.842292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.843738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:09.854709 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:09.855606 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:09.856500 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:09.861129 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 368/740] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:09.862331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:09.913759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.940701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141478c5-6b47-4e53-a140-b37a2ae7fe3f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.962770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766438b2-4c7b-432c-9ecc-4fab69deec52 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:09.980512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.981294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.981733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.982122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:09.983378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:09.985730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:09.990902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:09.998333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:09.998945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:09.999246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:09.999514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.000226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:10.000564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.002395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.009022 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 373/741] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:09 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:10.041010 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 369/742] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:10.059918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.188982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe625e4-a3f2-4607-998c-9815b28c7bdf None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.231323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.231989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.232258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.232581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.233208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.234620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3c53f39b-fff4-4886-838a-2a2e8f412143 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:10.244652 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:10.245912 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:10.246927 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 374/743] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:10.252259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.324095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49c76c-914e-431d-99fb-f9fd2675520a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.324427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49c76c-914e-431d-99fb-f9fd2675520a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.324627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49c76c-914e-431d-99fb-f9fd2675520a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.326369 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 375/744] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:10.331829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.332112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.332385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.354266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:10.355474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:10.366803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd559-46fe-4a20-937b-1be9f8b3ee4a None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.376223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.409109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.409737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.410007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.410280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.411154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:10.411450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.413586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.419795 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 370/745] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.422106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.426727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.441583 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 376/746] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:10.531327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefd82-4985-4b02-9523-01bb0a4cfd00 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.568434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.569079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.569356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.569623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.570257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:10.570556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.571948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.579231 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 371/747] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.584864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.688599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498fa128-63d2-41fd-8745-4ceac86283fc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.722582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.723420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.723907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.724329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.725572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] RBAC: Adding query filter params (interface=admin, service_id=62fb0ee477634b17b4d3b914df8f98f8, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:10.726020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.726762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.727828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.734430 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 377/748] 10.222.0.13 () {56 vars in 1249 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/endpoints?service_id=62fb0ee477634b17b4d3b914df8f98f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:10.743232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:10.763782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.843118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff516-e107-4938-a68e-adbe092f5483 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.854012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d80d3-43c6-48bb-96f8-fae8cec2e67e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:10.857134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:10.887445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.888210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.888818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.889116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.889952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.891338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.893685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:10.894367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:10.894703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:10.895032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:10.895701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:10.897149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:10.900699 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:10.901963 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:10.902809 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 372/749] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:10.909028 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 378/750] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:44:10.910148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.020781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.025918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eb4c2-bcf9-4f50-a7ee-1430b1194216 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.062239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.062870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.063139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.063404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.064064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.064355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.065811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.072014 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 373/751] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:11.080094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.192344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc357d-4f00-4788-93e4-8bc47f9ef976 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.206500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:11.227788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.228447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.228718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.229013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.229637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.229929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.231343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.236992 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 379/752] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.242855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.344626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bf3f8-6046-457d-8164-fd305d89fb80 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.380866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.381833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.382317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.382784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.383762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] RBAC: Adding query filter params (interface=public, service_id=754c51f0a32746f5802ce8f3be4ac6a2, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:11.384267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.385897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c771ee-0601-483a-8408-8bdb89df7aa6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.391781 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 374/753] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/endpoints?service_id=754c51f0a32746f5802ce8f3be4ac6a2&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:11.397767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:11.502242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11dd5f-caf8-4cd8-ad3c-660216959896 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:11.538270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:11.539261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:11.539756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:11.540240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:11.541069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:11.542656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7daff-16ea-4abd-8ccc-d9a8acc4cb55 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:11.549937 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 380/754] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:11 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:44:12.242947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0610fe8-cd91-4a2b-bd20-1bac005e4621 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.243229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0610fe8-cd91-4a2b-bd20-1bac005e4621 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.243743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0610fe8-cd91-4a2b-bd20-1bac005e4621 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.245580 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 375/755] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:12.251155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1a67-45a7-459b-931e-8ca9ab50832f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.252012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1a67-45a7-459b-931e-8ca9ab50832f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.252496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb1a67-45a7-459b-931e-8ca9ab50832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.272502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d3eb1a67-45a7-459b-931e-8ca9ab50832f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:12.274153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d3eb1a67-45a7-459b-931e-8ca9ab50832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:12.314799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.348552 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 381/756] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:12.395494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca013f-a178-48a6-aa0f-76bd1266f385 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.396476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca013f-a178-48a6-aa0f-76bd1266f385 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.396988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca013f-a178-48a6-aa0f-76bd1266f385 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.398801 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 376/757] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:12.404301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.404591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.405124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.424040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:12.425269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:12.494877 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 382/758] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:12.618643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca013f-a178-48a6-aa0f-76bd1266f385 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.647523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.725471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca013f-a178-48a6-aa0f-76bd1266f385 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.762879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.764427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.765085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.765355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.765619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.766204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.767554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:12.776653 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:12.777859 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:12.778708 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 377/759] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:12.783768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.885726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.895591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e565cf-7b07-4200-b129-859b6e02adc7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.897708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:12.899710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b267f-562d-4407-bd4b-c6cbf6a677b0 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:12.934964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.935731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.936070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.936411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.937582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.939630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.942480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:12.943300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:12.943758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:12.944199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:12.945062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:12.945534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:12.947073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:12.954119 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 378/760] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:12.959724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.sql.core [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:44:12.959724 dv-cinder-master-3-smb devstack@keystone.service[81465]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:44:12.959724 dv-cinder-master-3-smb devstack@keystone.service[81465]: [parameters: {'user_id': '769ad94592b04afc9b14aba40211affd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:44:12.959724 dv-cinder-master-3-smb devstack@keystone.service[81465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:44:12.960298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:12.971655 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:12.972600 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application yield resource Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise self.value Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application session.commit() Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:44:12.973555 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:44:12.974505 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:12.975398 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:12.976208 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [parameters: {'user_id': '769ad94592b04afc9b14aba40211affd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:12.983657 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 16 00:44:12.986164 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 383/761] 10.222.0.13 () {60 vars in 1131 bytes} [Sun Oct 16 00:44:12 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:12.989351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.102556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253f003-7848-4d60-9245-9f8216f98452 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.119447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964acaf0-30e1-49d9-ba76-d963e87e9cc0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.137271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.137871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.138162 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.138447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.139170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] RBAC: Adding query filter params (type=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:13.139476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.140881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.151107 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 379/762] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:13.152017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.158891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.159810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.160282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.160742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.169419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.171307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.172934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3e9b3e12-b575-4571-b5c5-8503e27da490 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:13.183225 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:13.184170 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 16 00:44:13.185741 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:13.189338 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 384/763] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:13.190448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025fdf5-572a-4ae6-a483-831ab74d8709 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.190714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025fdf5-572a-4ae6-a483-831ab74d8709 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.190975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025fdf5-572a-4ae6-a483-831ab74d8709 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.199390 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 385/764] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:13.199390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025fdf5-572a-4ae6-a483-831ab74d8709 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.220933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:13.262579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070c18-467f-4144-9ce0-a80b2ed2d03f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.298971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.299579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.299852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.300108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.300802 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] RBAC: Adding query filter params (interface=public, service_id=4420f104f7344426825a7020fa77c755, region_id=RegionOne) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:13.301132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.302509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09dc5c-25ec-49a4-af6f-38a9c37b6310 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.303642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025fdf5-572a-4ae6-a483-831ab74d8709 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.307666 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 380/765] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:44:13 2022] GET /identity/v3/endpoints?service_id=4420f104f7344426825a7020fa77c755&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:13.308920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.309201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.309469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.329346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:13.330765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:13.341909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.342520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.342796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.343062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.343752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:13.344047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.345508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.392956 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 386/766] 10.222.0.13 () {56 vars in 1101 bytes} [Sun Oct 16 00:44:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:13.392956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.416383 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 381/767] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:13 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:13.487716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:13.507899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afbf59-7160-4682-8e31-1cdc4725f6ff None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.551929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.552552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.552829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.553130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.553746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.555163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825687cb-73fb-47d1-9b18-c93d0c4ae20c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.563190 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 387/768] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:44:13 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:44:13.683854 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.699191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:13.763104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd4c-aa60-42eb-b7e8-e96e5ce12670 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.763423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd4c-aa60-42eb-b7e8-e96e5ce12670 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.763691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248fd4c-aa60-42eb-b7e8-e96e5ce12670 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.765076 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 388/769] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:13.770382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.770659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.770922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.790272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:13.792895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5cee8-ef55-4562-9eb0-8e1880d2c291 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.793256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:13.830370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.831634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.831634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.831634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.832099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.833497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:13.842474 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:13.843544 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:13.845156 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 382/770] 10.222.0.13 () {56 vars in 1126 bytes} [Sun Oct 16 00:44:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:13.849652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:13.867268 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 389/771] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:13 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:13.930953 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:13.955423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3515bbe-f51f-4559-828a-f8fbe44bf674 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:13.989928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:13.990535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:13.990809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:13.991075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:13.991698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:13.992195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:13.993599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:13.998800 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 383/772] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:14.004410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.088373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:14.113510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7d46-9c76-4248-b623-d0fe8013d6f6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.127194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.151070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.151669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.151945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.152204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.152851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:14.153144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.154569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.160037 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 390/773] 10.222.0.13 () {56 vars in 1122 bytes} [Sun Oct 16 00:44:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:14.165669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.229154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01e432-96f4-443f-8ba5-d550b5fc0110 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.267551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.268489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.269047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.269329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.270089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.272025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.273383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d014869-fa1e-4616-8be2-e4714386d39f None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:14.282256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:14.283272 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:14.284267 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 384/774] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:14.290055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.294372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:14.312994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.313643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.313876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.314139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.315206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.316582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.334037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:14.340355 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 391/775] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:14 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:14.412653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f39bee-9eb1-4503-a918-e83dcab7559d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.457623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.458304 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.458553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.458739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.459424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:14.459683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.461212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.467640 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 385/776] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:14.473785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.581259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c665-c3db-4666-a843-54126e8f141c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.621605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.622594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.623120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.623581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.624669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:14.625220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.627693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458064a4-b53d-4004-9e93-f7ba1c07a65c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.635704 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 392/777] 10.222.0.13 () {56 vars in 1112 bytes} [Sun Oct 16 00:44:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:14.643763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:14.709154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:14.749761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367aed5-ee0b-4ef1-b4fa-bc1562abeb50 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:14.784082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:14.784688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:14.784977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:14.785244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:14.785913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:14.787279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fd3b7-50ad-4546-a74f-912b07c7dbc5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:14.816874 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 386/778] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:44:15.755810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fdd5-9b98-42f6-9940-bc94082b676e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.756402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fdd5-9b98-42f6-9940-bc94082b676e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.756402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fdd5-9b98-42f6-9940-bc94082b676e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.757909 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 393/779] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:15.763061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:15.763526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:15.763715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:15.782249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:15.783435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:15.856188 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 387/780] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:16.117195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fdd5-9b98-42f6-9940-bc94082b676e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.184121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.226928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fdd5-9b98-42f6-9940-bc94082b676e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.262596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.263222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.263531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.263768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] PATH_INFO: `/v3/services/image` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.264374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.265833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:16.274888 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:16.275879 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:16.277899 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 394/781] 10.222.0.13 () {56 vars in 1105 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:16.282058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.329658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.393377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a871fef-af23-4fd8-a4c6-c773e85ab479 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.429227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.429797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.430105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.430361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.430980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] RBAC: Adding query filter params (name=image) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:16.431277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.432650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458828-8eb4-43f1-873f-2094eebb1532 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.437794 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 388/782] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:16.443446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.468222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d57c-1890-4d30-89a2-81d2cbd84dfc None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.468546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d57c-1890-4d30-89a2-81d2cbd84dfc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.468772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035d57c-1890-4d30-89a2-81d2cbd84dfc None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.470321 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 389/783] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:16.475349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.475633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.475891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.494993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:16.496219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:16.549793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550aad9-9d63-49f2-ada1-89696d3c7f78 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.566669 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 390/784] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:16.577495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.585899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.586559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.586830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.587147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.587773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] RBAC: Adding query filter params (type=image) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:16.588066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.589549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.599148 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 395/785] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:16.600775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.646365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:16.704952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabf16-0c35-46ea-ad90-589b9ee42f83 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.739344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.739953 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.740228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.740492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.741180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.742630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:16.763562 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 391/786] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:44:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:16.834182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:16.953912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dabca1-c541-45c6-bd80-9450b7c37380 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:16.996139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:16.996775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:16.997073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:16.997334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:16.998531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:16.999965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400ba6e-bffb-4325-a6f1-daea47948e7c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.002016 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 396/787] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:17.007966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.009557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eb20-e750-4be9-9a89-5b369a857da6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.009832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eb20-e750-4be9-9a89-5b369a857da6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.010094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737eb20-e750-4be9-9a89-5b369a857da6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.011458 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 397/788] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:17.016385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.016650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.016942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.034882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:17.036060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:17.090428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.109643 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 398/789] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:17.114730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.122157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ead6a-cdee-43e5-90bc-b2f73fe9c4a1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.281615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.282228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.282472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.282758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.283408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.284850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.320884 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 392/790] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:17 2022] POST /identity/v3/projects => generated 311 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:17.373018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.481614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1b755-395a-42d5-b008-b81de4632a84 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.521205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.521847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.522117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.522386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.534431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:17.539536 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:17.540508 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:17.541416 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 399/791] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:17.546836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.649012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a4e-4b30-4919-b399-79eb9eed686f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.691974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.692587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.692861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.693142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.693790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:17.694093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.695511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.708477 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 393/792] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:17.709767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.757769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.810567 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e261d2-132e-4ac6-9b0d-612ccec68c3c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:17.844104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:17.844848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:17.845076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:17.845341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:17.855334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:17.856774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:17.871341 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:17.872263 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:17.873199 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:17.873199 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:17.873199 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:17.873199 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 400/793] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:17.879533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:17.892576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:17.985803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f58c3-70be-4d30-98b1-4edd016fa8bc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.021877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.022489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.022756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.023018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.023656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.023950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.025360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.040914 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 394/794] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:18.042788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.143852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.148338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e2dd-cd7e-4722-a4a8-75dc48f7aa7e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.183123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.183751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.184029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.184287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.191796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.193262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:18.204345 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:18.205384 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:18.206332 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:18.207457 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 401/795] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.211294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.282633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.315135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d51ea-314d-4462-92a3-c08de76943f3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.349302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.349824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.350091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.350354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.351065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.351357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.352789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.370487 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 395/796] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:18.376255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.598009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f142919-13f8-4465-8f61-e24b29fd3752 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.635145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.635697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.635964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.636225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.646417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.647874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:18.662279 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:18.663227 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:18.664103 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:18.664103 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:18.664103 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:18.665196 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 402/797] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.669186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.768424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd72f2-b564-4239-9b74-8758f147d828 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.794514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.803751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.804355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.804624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.804919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.805559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:18.805858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.807265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce86930-23fc-4a77-a423-d78ce0d40bbf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.820269 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 396/798] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:18.826142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:18.839998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:18.928754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c57de3-6302-453d-878d-159b9bfa47ae None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:18.934021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558af3-21b1-4f44-9259-9474d129f02b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.934456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558af3-21b1-4f44-9259-9474d129f02b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.934550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22558af3-21b1-4f44-9259-9474d129f02b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.936203 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 397/799] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:18.941102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.941382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.941654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.959593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:18.961040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:18.963870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:18.964494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:18.964762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:18.965046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:18.971796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:18.973255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:18.984509 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:18.985804 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:18.986701 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 403/800] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:18.991714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.035703 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 398/801] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:19.062403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:19.099207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721de3b-52b1-4686-9278-46df0f496d92 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.132672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.133299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.133574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.133829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.134505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:19.134830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.136257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.148853 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 404/802] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:19.154943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.255239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49937e-2948-4a03-b047-f9140cbbdf35 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.271848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:19.289754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.290413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.290685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.290947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/08eae8aaf7a549a49ed2f9dc8dc09220` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.293183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=3741f090453c44c2b2d2d2b41af8330d, role_id=08eae8aaf7a549a49ed2f9dc8dc09220)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.294701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.302894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.310342 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 399/803] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:19 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/3741f090453c44c2b2d2d2b41af8330d/roles/08eae8aaf7a549a49ed2f9dc8dc09220 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:19.418727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2fd7b-2cfe-47d4-82b3-e4752beaa66d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.453393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:19.460782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.461441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.461710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.461971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.462652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.464018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.473131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.sql.core [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:19.473131 dv-cinder-master-3-smb devstack@keystone.service[81465]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:19.473131 dv-cinder-master-3-smb devstack@keystone.service[81465]: [parameters: {'id': '1b66e1499ec54be3a590b8b2b644e841', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:44:19.473131 dv-cinder-master-3-smb devstack@keystone.service[81465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9b2c4543-40a4-418c-b770-00b85e756b4f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:19.480463 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 16 00:44:19.481413 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application yield resource Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application next(self.gen) Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.rollback() Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.force_reraise() Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise self.value Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application session.commit() Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 16 00:44:19.482436 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._prepare_impl() Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.session.flush() Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._flush(objects) Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application compat.raise_( Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application flush_context.execute() Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rec.execute(self) Oct 16 00:44:19.483934 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 16 00:44:19.485765 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result = self._query(query) Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application conn.query(q) Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application result.read() Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 16 00:44:19.488027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [parameters: {'id': '1b66e1499ec54be3a590b8b2b644e841', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 16 00:44:19.489947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:19.490950 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:19.492036 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 405/804] 10.222.0.13 () {60 vars in 1137 bytes} [Sun Oct 16 00:44:19 2022] POST /identity/v3/domains => generated 190 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:19.493760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.507127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1396ef-e317-4b63-b2dc-a99684d90ed2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.507365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1396ef-e317-4b63-b2dc-a99684d90ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.507642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1396ef-e317-4b63-b2dc-a99684d90ed2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.509282 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 406/805] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:19.514320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.514713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.515004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.534304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:19.535654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:19.611404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fe28c-6a53-4bb8-ab8a-6140bac3f3ea None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.614839 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 407/806] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:19.644538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.645200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.645472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.645742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.659141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.660754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:19.676646 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:19.677660 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:19.679095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:19.679095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:19.679095 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:19.679095 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 400/807] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:19.683949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.785833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9f2f-44a6-4ffd-8cbd-b427c6c4df05 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:19.809421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:19.822840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:19.823449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:19.823725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:19.823984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:19.824618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:19.824956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:19.826359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:19.841177 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 408/808] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:19.891517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:19.926741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:20.005744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677890d-30ae-47ff-9212-a61a0d40ded1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:20.042064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:20.042630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.042899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.043159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.044256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:20.045806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6998d6-0abd-41ec-8ee1-bd374d272472 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:20.047373 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 401/809] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:20.053193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:20.159298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4c6f9-ae22-40b4-8d1c-0855c9bc9cb6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:20.191545 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:20.192178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:20.192447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:20.192707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:20.193455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:20.194938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd027e8-cdc0-4b7f-a150-d5efe562f432 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:20.217341 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 409/810] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:20 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:21.449255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed8bd-888a-402b-a8fc-38ee0ca4dc5a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.449779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed8bd-888a-402b-a8fc-38ee0ca4dc5a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.449779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ed8bd-888a-402b-a8fc-38ee0ca4dc5a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.451093 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 402/811] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:21.456477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.456904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.457161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.476585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:21.477819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:21.513454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.546608 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 410/812] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:21.812225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ed8bd-888a-402b-a8fc-38ee0ca4dc5a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:21.911912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:21.917336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ed8bd-888a-402b-a8fc-38ee0ca4dc5a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:21.952926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:21.953574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:21.953849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:21.954112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:21.964903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:21.969849 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:21.970784 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:21.971840 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 403/813] 10.222.0.13 () {56 vars in 1120 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:21.977606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.074104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee93ead-f5fc-4c91-b125-052d3da3e687 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.112562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.113258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.113525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.113792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.114452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.114753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.116124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.124594 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 411/814] 10.222.0.13 () {56 vars in 1115 bytes} [Sun Oct 16 00:44:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:22.130667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.237620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02ae72-909f-4fcf-a87a-67ce63fa7ba8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.275352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.275975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.276250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.276516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.286974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.288432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-dfe309ca-68db-4542-b823-4b9fbe15f1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:22.303226 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.304214 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:22.305122 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:22.305122 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:22.305122 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:22.305122 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 404/815] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:22.310328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.339436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29739-a42e-43bc-8b7b-7de1664521b1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.339618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29739-a42e-43bc-8b7b-7de1664521b1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.339869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f29739-a42e-43bc-8b7b-7de1664521b1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.341344 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 405/816] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:44:22.343801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.346287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.346576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.346844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.365000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:22.366198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:22.369034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.414021 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ceedb-7a90-4f23-8c6e-d9c2be6eb12a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.431768 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 406/817] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:22.445482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.446084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.446351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.446610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.447236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.447527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.448915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.460538 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 412/818] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:22.466422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.564602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807cde2-6f6d-4f24-8670-242eb3fe0baf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.598752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.599293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.599561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.599826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.606960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.608405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.611402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:44:22.621878 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.622956 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:22.623894 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 407/819] 10.222.0.13 () {56 vars in 1093 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:22.629060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.701074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.724282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.735557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df8228-6b8e-40d3-b934-f3168682ad45 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.770905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.771505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.771778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.772029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.772768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.773097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.774557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:22.791342 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 413/820] 10.222.0.13 () {56 vars in 1133 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:22.797188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.801094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acfbbd-0a2e-4ec7-8fbc-e91c73df530b None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.834835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.835440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.835715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.835981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.846881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:22.852108 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:22.853256 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:22.854444 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 408/821] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:22.859159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:22.897005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb37c82-c568-4b86-9b85-0eced0ff0a39 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.916857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.931679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.932312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.932569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.932830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.951273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:22.956852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baf7e0-8406-4c02-b065-09a06d4a4799 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:22.991002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:22.991602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:22.991897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:22.992164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:22.992817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:22.993147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:22.994537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.000194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.001686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.002674 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 409/822] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:23.008562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.103752 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 414/823] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 16 00:44:23.110421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.112116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953c12a-4509-48c0-83d1-8b28ae6f1853 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.134482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.146641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.147270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.147545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.147814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] PATH_INFO: `/v3/users/e88b91af8dc6448192bc60c20767f823` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.159300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.161167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] RBAC: Authorizing `identity:get_user(user_id=e88b91af8dc6448192bc60c20767f823)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.162642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.164257 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 410/824] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/users/e88b91af8dc6448192bc60c20767f823 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:23.170102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.206856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad044a-42ed-4f40-81d9-f39a2c58e263 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.243078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.243737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.244002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.244259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.254994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.256434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:44:23.270621 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:23.271568 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:44:23.272474 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:44:23.272474 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:44:23.272474 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:23.272474 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 415/825] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:23.277552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.280231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a02a9-da0f-41de-9d03-f2714e2642cd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.317475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.318102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.318372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.318617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.319783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f6040cfdc4f4383fd701b9c68cca3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.321252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.322863 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 411/826] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:23.330911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.378802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051103e1-1e0a-4e75-8c1e-54c35fd53721 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.380360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.401517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.414999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.415631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.416005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.416293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.417028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.417385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.418794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.430682 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 416/827] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:23.436566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.456852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371382f-a77a-4345-adcd-3b2f7adce238 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.491132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.491862 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.492325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.492598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3/users/e88b91af8dc6448192bc60c20767f823/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.494622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f6040cfdc4f4383fd701b9c68cca3, user_id=e88b91af8dc6448192bc60c20767f823, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.496051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.509464 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 412/828] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:23 2022] PUT /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3/users/e88b91af8dc6448192bc60c20767f823/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:23.545823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffadbaf-2eaf-49dc-9646-e0e530e02365 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.585803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.586464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.586722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.586997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.596701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.598218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:44:23.618732 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:23.619890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:23.620782 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 417/829] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:44:23.626840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.738982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a83145-e29c-4af8-bddb-588a8a49df1c None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.748143 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.774476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.775072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.775366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.775626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.776305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.776599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.778055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c4b0e-31f3-4582-b9ab-ceffc30284dd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.790760 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 413/830] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:23.797045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:23.825130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:23.904452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9dbf-b887-4608-a248-be79de7b565b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:23.940278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:23.940867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:23.941162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:23.941428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:23.942146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] RBAC: Adding query filter params (role.id=08eae8aaf7a549a49ed2f9dc8dc09220, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=3741f090453c44c2b2d2d2b41af8330d) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:23.942446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:23.943858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b9ba4-359a-4ef6-8273-a7b5b66fe6da None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:23.949828 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 418/831] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:23 2022] GET /identity/v3/role_assignments?user.id=3741f090453c44c2b2d2d2b41af8330d&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=08eae8aaf7a549a49ed2f9dc8dc09220 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:25.666364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8391ce-d00b-4c08-bfda-1ebc20642697 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.667004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8391ce-d00b-4c08-bfda-1ebc20642697 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.667004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8391ce-d00b-4c08-bfda-1ebc20642697 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.668215 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 414/832] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:25.674754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:25.675495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:25.675633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:25.704623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:25.705876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:25.779102 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 419/833] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:26.060504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8391ce-d00b-4c08-bfda-1ebc20642697 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.176889 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8391ce-d00b-4c08-bfda-1ebc20642697 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.213042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.213662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.213932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.214198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.225232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:26.229996 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:26.233027 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:26.234118 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 415/834] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:26.237707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.255921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.343291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407338d0-7ed1-4a8c-9854-9ecd44e7b40e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.380177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.380771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.381074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.381337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.381992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:26.382287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.383659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.392166 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 420/835] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:26.398829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.431478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.511021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39341-85a0-4c58-a68b-df3b7a0421d1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.549122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.549730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.550002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.550265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] PATH_INFO: `/v3/users/e88b91af8dc6448192bc60c20767f823` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.551436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] RBAC: Authorizing `identity:get_user(user_id=e88b91af8dc6448192bc60c20767f823)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.552888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.554456 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 416/836] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/users/e88b91af8dc6448192bc60c20767f823 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:26.560534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.642310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.669823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01767cc-5c90-4e4e-86fa-9dbc7eec967b None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:26.703807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:26.704420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:26.704641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:26.704937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:26.782036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:26.783474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:26.863847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:26.892727 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 421/837] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:26.898792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:26.998650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:27.006493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a99c7-dd4a-4f7e-8ad5-36335d98ff58 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.042218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.042831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.043099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.043366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.044607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a32f6040cfdc4f4383fd701b9c68cca3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.046075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdde2cb-81d9-414f-bff0-6262caabd1f1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.047682 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 417/838] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:26 2022] GET /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:27.054331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:27.166702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652926f-f067-44b9-ab19-b736a1d74726 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:27.201203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:27.201791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:27.202061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:27.202330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:27.203050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=a32f6040cfdc4f4383fd701b9c68cca3, user.id=e88b91af8dc6448192bc60c20767f823) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:27.203356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:27.204777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022f53b-ec0f-41d0-bf43-df50e26b20f0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:27.210575 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 422/839] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:27 2022] GET /identity/v3/role_assignments?user.id=e88b91af8dc6448192bc60c20767f823&scope.project.id=a32f6040cfdc4f4383fd701b9c68cca3&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:29.336286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112fb2-e3b4-4742-bfed-33ae4cff681a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.336871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112fb2-e3b4-4742-bfed-33ae4cff681a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.336871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63112fb2-e3b4-4742-bfed-33ae4cff681a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.338116 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 418/840] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:29.343666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.344093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.344188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.364698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:29.365907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:29.405107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:29.439607 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 423/841] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:29.709237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63112fb2-e3b4-4742-bfed-33ae4cff681a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.820389 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63112fb2-e3b4-4742-bfed-33ae4cff681a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:29.864711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:29.865364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:29.865638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:29.865904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:29.867079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:29.868522 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a340f-28ea-4565-ad4e-ccd2ff8aea85 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:29.870152 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 419/842] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:29.876069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:29.982339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc6f9f-006f-40c3-ae87-fdafe52743aa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:30.026929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:30.027868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:30.028295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:30.028671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:30.029760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:30.032045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8c17d-82e0-4386-ab91-a4b215ef0723 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:30.060999 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 424/843] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:29 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:32.194393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f98e-9d19-45ad-8b28-c6728cd6eb6b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.194980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f98e-9d19-45ad-8b28-c6728cd6eb6b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.194980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f98e-9d19-45ad-8b28-c6728cd6eb6b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.196283 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 420/844] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:32.202747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.203434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.203586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.233407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:32.234943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:32.268450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.323049 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 425/845] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:32.585740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f98e-9d19-45ad-8b28-c6728cd6eb6b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.622695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:32.702682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f98e-9d19-45ad-8b28-c6728cd6eb6b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.736919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.737586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.737854 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.738158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] PATH_INFO: `/v3/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.739565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] RBAC: Authorizing `identity:get_role(role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.740962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.742259 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 421/846] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/roles/8580d6ffb0314695b7d97c77052b2597 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:32.748368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:32.859144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66c463-5342-44ed-b8c5-3cd93a9ef7b9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:32.894721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:32.895330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:32.895593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:32.895856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] PATH_INFO: `/v3/users/6221d3f0ca71489d97091a1a1fcd3276` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:32.911013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] RBAC: Authorizing `identity:get_user(user_id=6221d3f0ca71489d97091a1a1fcd3276)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:32.912423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:32.914002 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 426/847] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/users/6221d3f0ca71489d97091a1a1fcd3276 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:32.921930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.022268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.025509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509b410-a072-48d7-9112-8649e2c272b9 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.061417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.062029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.062300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.062566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.063718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] RBAC: Authorizing `identity:get_project(project_id=a32f6040cfdc4f4383fd701b9c68cca3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.065247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5c3105-5dcd-4638-931c-1a11a9cd1a8c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.066846 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 422/848] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:32 2022] GET /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:33.072876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:33.091521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:33.179672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290379-3f42-4129-b5d7-b3ad50f65af8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:33.225952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:33.226556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:33.226857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:33.227122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3/users/6221d3f0ca71489d97091a1a1fcd3276/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:33.229295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] RBAC: Authorizing `identity:create_grant(project_id=a32f6040cfdc4f4383fd701b9c68cca3, user_id=6221d3f0ca71489d97091a1a1fcd3276, role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:33.230758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff34a9-bda4-47fe-8b56-c4b5cbb3be25 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:33.248583 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 427/849] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:33 2022] PUT /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3/users/6221d3f0ca71489d97091a1a1fcd3276/roles/8580d6ffb0314695b7d97c77052b2597 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:35.337898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e461-e868-4fa8-8e42-7d0703bd1c46 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.338737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e461-e868-4fa8-8e42-7d0703bd1c46 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.338737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059e461-e868-4fa8-8e42-7d0703bd1c46 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.341030 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 423/850] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:35.346585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.347015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.347122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.373740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:35.375574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:35.448520 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 428/851] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:35.723638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e461-e868-4fa8-8e42-7d0703bd1c46 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:35.840112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059e461-e868-4fa8-8e42-7d0703bd1c46 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:35.874984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:35.875600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:35.875877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:35.876148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] PATH_INFO: `/v3/roles/8580d6ffb0314695b7d97c77052b2597` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:35.877618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] RBAC: Authorizing `identity:get_role(role_id=8580d6ffb0314695b7d97c77052b2597)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:35.879003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:35.880320 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 424/852] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/roles/8580d6ffb0314695b7d97c77052b2597 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:35.886549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:35.895418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:35.989528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7036ec-29c5-4ad6-8e82-a129b9b69f0b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.025671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.026285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.026560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.026827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] PATH_INFO: `/v3/users/6221d3f0ca71489d97091a1a1fcd3276` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.028023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] RBAC: Authorizing `identity:get_user(user_id=6221d3f0ca71489d97091a1a1fcd3276)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.029517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.031074 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 429/853] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:35 2022] GET /identity/v3/users/6221d3f0ca71489d97091a1a1fcd3276 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.037844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.076995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.142769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd60d18-0380-431c-b89e-be7b851a05ec None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.178093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.178701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.178973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.179238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.247734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.249142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.282726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.350110 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 425/854] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:36.360193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.445586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.470994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d892803-c414-42c0-8a88-3e589bed9274 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.507228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.508026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.508298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.508561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] PATH_INFO: `/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.509709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] RBAC: Authorizing `identity:get_project(project_id=a32f6040cfdc4f4383fd701b9c68cca3)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.511136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e418e7e-91c5-4666-8a86-ee25778d8cec None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.512745 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 430/855] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/projects/a32f6040cfdc4f4383fd701b9c68cca3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:36.522480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:36.627822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0647-2542-43ec-93a6-c8b82b8b4d79 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:36.662154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:36.662734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:36.663001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:36.663267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:36.663976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] RBAC: Adding query filter params (role.id=8580d6ffb0314695b7d97c77052b2597, scope.project.id=a32f6040cfdc4f4383fd701b9c68cca3, user.id=6221d3f0ca71489d97091a1a1fcd3276) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:36.664269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:36.665723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16900a08-a40d-4666-9c58-8ea264e0bb5a None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:36.668480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:36.671772 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 426/856] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:36 2022] GET /identity/v3/role_assignments?user.id=6221d3f0ca71489d97091a1a1fcd3276&scope.project.id=a32f6040cfdc4f4383fd701b9c68cca3&role.id=8580d6ffb0314695b7d97c77052b2597 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:38.759341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf711a-a85e-4a76-a0c7-449643cd3ea5 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.760306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf711a-a85e-4a76-a0c7-449643cd3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.760306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf711a-a85e-4a76-a0c7-449643cd3ea5 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.762430 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 431/857] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:38.770663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:38.771127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:38.771224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:38.790036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:38.791201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:38.862964 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 427/858] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:39.128299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf711a-a85e-4a76-a0c7-449643cd3ea5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.240325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf711a-a85e-4a76-a0c7-449643cd3ea5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.274840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.275445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.275711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.275972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.277142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.278653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fe695-9257-485e-b5eb-81c66caab7f4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.280192 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 432/859] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:39.287099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:39.394007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e0993-6cbf-46b3-8993-d5f9990f10b5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:39.423042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:39.430226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:39.430821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:39.431097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:39.431360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:39.432003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:39.433478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ab286-7ce4-4eec-b573-1c8e2288b004 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:39.462840 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 428/860] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:39 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:41.609891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf870b2-d4bf-4270-8b83-233271d663eb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.610795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf870b2-d4bf-4270-8b83-233271d663eb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.610795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf870b2-d4bf-4270-8b83-233271d663eb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.612906 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 433/861] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:41.621270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:41.621733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:41.621841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:41.641667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:41.642854 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:41.716384 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 429/862] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 16 00:44:41.979344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf870b2-d4bf-4270-8b83-233271d663eb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:41.994268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:42.096957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf870b2-d4bf-4270-8b83-233271d663eb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.131305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.132034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.132381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.132656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.133811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.135260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c020b-2912-4ec2-a29a-96f3e5b98d79 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.136864 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 434/863] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:42.142799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:42.237872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be425e4-cd2c-4aaf-8383-14cfa7002745 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:42.251927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:42.274646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:42.275250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:42.275525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:42.275792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:42.276434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:42.278076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edddec-38c5-4564-958c-5dbc72986fc7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:42.301348 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 430/864] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:42 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:44.420381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e9b0-d0e5-445c-a880-21d4e5e652d1 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.420976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e9b0-d0e5-445c-a880-21d4e5e652d1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.420976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5e9b0-d0e5-445c-a880-21d4e5e652d1 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.422196 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 435/865] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:44.427648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.428088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.428185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.448135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:44.449313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:44.520005 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 431/866] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:44.785333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e9b0-d0e5-445c-a880-21d4e5e652d1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:44.873588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:44.899360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5e9b0-d0e5-445c-a880-21d4e5e652d1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:44.935776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:44.936393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:44.936670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:44.936986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:44.947581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:44.952461 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:44.953599 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:44:44.954529 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 436/867] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:44.960569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.068156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:45.073031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea489e-d2fe-4104-809a-b67ddac732ea None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.113086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.113682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.113957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.114226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.114886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:45.115182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.116566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.124432 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 432/868] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:45.130630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.241465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705f09-9189-476b-a207-531fc7261c52 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.276236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.276877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.277148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.277414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] PATH_INFO: `/v3/users/825f697a5cd04125b91ba165ce89ade7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.285126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:45.292169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=825f697a5cd04125b91ba165ce89ade7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.293679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.295258 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 437/869] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/users/825f697a5cd04125b91ba165ce89ade7 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:45.301358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.406845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979d8-7e30-46c4-ac7b-8837e05c0000 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.441105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.441711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.441988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.442256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] PATH_INFO: `/v3/projects/3bb7b50e29a546829a9cb6db7983b205` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.443490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] RBAC: Authorizing `identity:get_project(project_id=3bb7b50e29a546829a9cb6db7983b205)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.444966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cbe9b-a02f-4018-987f-64de2b463c88 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.446600 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 433/870] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:45 2022] GET /identity/v3/projects/3bb7b50e29a546829a9cb6db7983b205 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:45.453005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:45.555848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920499ef-63c3-4d3d-ab90-373d6187d1e5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:45.590789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:45.591429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:45.591703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:45.591970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] PATH_INFO: `/v3/projects/3bb7b50e29a546829a9cb6db7983b205/users/825f697a5cd04125b91ba165ce89ade7/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:45.594126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bb7b50e29a546829a9cb6db7983b205, user_id=825f697a5cd04125b91ba165ce89ade7, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:45.595556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fb6d4-47f8-4844-9018-bf1b1beaa338 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:45.612430 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 438/871] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:44:45 2022] PUT /identity/v3/projects/3bb7b50e29a546829a9cb6db7983b205/users/825f697a5cd04125b91ba165ce89ade7/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:44:47.714788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa1a1-894c-4182-97ce-4a7c3b56e1d9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.715653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa1a1-894c-4182-97ce-4a7c3b56e1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.715653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa1a1-894c-4182-97ce-4a7c3b56e1d9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.717886 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 434/872] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:47.725902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:47.726312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:47.726468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:47.750298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:47.751488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:47.803396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:47.826891 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 439/873] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:48.090593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa1a1-894c-4182-97ce-4a7c3b56e1d9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.121885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.199096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa1a1-894c-4182-97ce-4a7c3b56e1d9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.233493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.234456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.234724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.234987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.245372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:44:48.250169 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:44:48.251234 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:44:48.252209 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 435/874] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:44:48.257486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.359289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f56f96-aa90-4300-8c9e-309ee12026ba None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.394143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.394739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.395008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.395272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.395919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:48.396204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.397612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.405647 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 440/875] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:44:48.414474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.515269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.531975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e8610-d30b-48bc-b039-a4266e1a8c20 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.569349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.569998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.570269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.570534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] PATH_INFO: `/v3/users/825f697a5cd04125b91ba165ce89ade7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.571790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] RBAC: Authorizing `identity:get_user(user_id=825f697a5cd04125b91ba165ce89ade7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.573271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.574909 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 436/876] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/users/825f697a5cd04125b91ba165ce89ade7 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:48.581592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:48.643145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.695627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d0707-71d9-41dd-95f7-52ac30da7cb8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:48.730023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:48.730640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:48.730933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:48.731200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:48.799243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:48.800674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:48.848305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:48.901611 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 441/877] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:44:48.911015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.020196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061a4dc-8a4a-4385-8c9c-c8c0198f74f1 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.054197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.054808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.055075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.055345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] PATH_INFO: `/v3/projects/3bb7b50e29a546829a9cb6db7983b205` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.056564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] RBAC: Authorizing `identity:get_project(project_id=3bb7b50e29a546829a9cb6db7983b205)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.058029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91181ef8-f9a9-4803-b44c-264d34ae62d1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.059660 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 437/878] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:44:48 2022] GET /identity/v3/projects/3bb7b50e29a546829a9cb6db7983b205 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:49.066378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:49.170495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89671a-db12-487f-94a0-77113f41eea4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:49.205572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:49.206163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:49.206433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:49.206694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:49.207407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=3bb7b50e29a546829a9cb6db7983b205, user.id=825f697a5cd04125b91ba165ce89ade7) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:44:49.207714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:49.209157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6fdcb-d357-44ee-9e76-bd2507e9f7cf None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:49.214918 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 442/879] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:44:49 2022] GET /identity/v3/role_assignments?user.id=825f697a5cd04125b91ba165ce89ade7&scope.project.id=3bb7b50e29a546829a9cb6db7983b205&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:51.353829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14777-5372-47d8-936b-d30321c79e11 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.354339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14777-5372-47d8-936b-d30321c79e11 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.354339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca14777-5372-47d8-936b-d30321c79e11 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.356309 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 438/880] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:51.365604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72791ab-7899-4634-9e45-1f85c6d98303 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.366017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72791ab-7899-4634-9e45-1f85c6d98303 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.366162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72791ab-7899-4634-9e45-1f85c6d98303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.387154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c72791ab-7899-4634-9e45-1f85c6d98303 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:51.388363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c72791ab-7899-4634-9e45-1f85c6d98303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:51.395761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.458847 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 443/881] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:51.722241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14777-5372-47d8-936b-d30321c79e11 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:51.751707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:51.832718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca14777-5372-47d8-936b-d30321c79e11 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:51.867939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:51.868521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:51.868805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:51.869112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:51.869770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:51.871201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04117a6-86f7-4311-9735-33d1df00e3b8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:51.893145 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 439/882] 10.222.0.13 () {60 vars in 1138 bytes} [Sun Oct 16 00:44:51 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:54.043431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37eff-5844-4b89-a840-69a0676e0a39 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.044033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37eff-5844-4b89-a840-69a0676e0a39 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.044033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc37eff-5844-4b89-a840-69a0676e0a39 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.045370 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 444/883] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:54.051876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.052587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.052728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.079672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:54.080869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:54.151767 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 440/884] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:54.414490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37eff-5844-4b89-a840-69a0676e0a39 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.520174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc37eff-5844-4b89-a840-69a0676e0a39 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.552774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.553423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.553695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.553960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] PATH_INFO: `/v3/domains/e6ee919924814b7c81a37da3710684af` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.563924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=e6ee919924814b7c81a37da3710684af)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.565433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84090d-64e1-4901-a8a8-4d63b206a89d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.566998 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 445/885] 10.222.0.13 () {56 vars in 1183 bytes} [Sun Oct 16 00:44:54 2022] GET /identity/v3/domains/e6ee919924814b7c81a37da3710684af => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:54.575786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:54.590853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:54.679295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd758-85a7-4b59-ac9c-372e4f3bbb9b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:54.714069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:54.714696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:54.714966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:54.715235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:54.715874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:54.717359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8996c-6f96-4636-a483-608f08a354ee None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:54.745610 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 441/886] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:44:54 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:56.890513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7218-f686-45d9-be30-edb01885dd6f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.891150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7218-f686-45d9-be30-edb01885dd6f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.891150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b7218-f686-45d9-be30-edb01885dd6f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.892433 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 446/887] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:56.898858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:56.899321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:56.899504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:56.925048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:56.926246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:56.989573 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:56.999065 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 442/888] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:44:57.263724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7218-f686-45d9-be30-edb01885dd6f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.267154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:57.368796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b7218-f686-45d9-be30-edb01885dd6f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.403483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.404093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.404362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.404630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] PATH_INFO: `/v3/domains/e6ee919924814b7c81a37da3710684af` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.405810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e6ee919924814b7c81a37da3710684af)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.407237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d23ee4-c6a3-4065-a081-549be46631f5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.408776 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 447/889] 10.222.0.13 () {56 vars in 1183 bytes} [Sun Oct 16 00:44:57 2022] GET /identity/v3/domains/e6ee919924814b7c81a37da3710684af => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:44:57.414772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:44:57.517239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b72096-02b7-43e5-9115-5b5116dc8832 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:44:57.552311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:44:57.552935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:57.553209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:57.553483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:57.554120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:44:57.555552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c19891-c711-4aaa-a13a-af59c2ebdac1 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:44:57.580105 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 443/890] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:44:57 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:44:59.717502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc4-7b00-4b1c-830f-0b35c7cad0cb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.718091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc4-7b00-4b1c-830f-0b35c7cad0cb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.718091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc4-7b00-4b1c-830f-0b35c7cad0cb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.719416 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 448/891] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:44:59.725982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:44:59.726750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:44:59.726878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:44:59.754073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:44:59.755262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:44:59.803254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:44:59.824099 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 444/892] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:00.092148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eadc4-7b00-4b1c-830f-0b35c7cad0cb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.171985 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.218500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eadc4-7b00-4b1c-830f-0b35c7cad0cb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.253839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.254458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.254728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.255047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.265737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:00.270556 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:00.272947 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:45:00.274141 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 449/893] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:00.278927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.383836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9bf8c4-0b20-46c5-a6c1-58eb8164df38 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.418553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.419142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.419407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.419667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.420323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:00.420610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.422013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.430096 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 445/894] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:00.436231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.537081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be01923-7ddb-4dee-8397-3d250edd3de6 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.566166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.572734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.573386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.573657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.573975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] PATH_INFO: `/v3/users/1c919bef6c2246d09144d054669ae200` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.587138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] RBAC: Authorizing `identity:get_user(user_id=1c919bef6c2246d09144d054669ae200)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.588583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.590224 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 450/895] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/users/1c919bef6c2246d09144d054669ae200 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:00.596428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.641895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:00.700027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eeac55-40be-4c9a-ac66-1af1aafd38fd None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.735151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.735747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.736040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.736313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] PATH_INFO: `/v3/projects/29ac7081a0c44149a5d905d742bad0be` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.737471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=29ac7081a0c44149a5d905d742bad0be)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.738912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cdf27a-2e67-4578-9101-c9c0cb31b2b0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.740549 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 446/896] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:00 2022] GET /identity/v3/projects/29ac7081a0c44149a5d905d742bad0be => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:00.746557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:00.846827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923ae17-8a82-4b29-a4e3-7893c6073692 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:00.881764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:00.882406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:00.882680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:00.882946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] PATH_INFO: `/v3/projects/29ac7081a0c44149a5d905d742bad0be/users/1c919bef6c2246d09144d054669ae200/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:00.885131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=29ac7081a0c44149a5d905d742bad0be, user_id=1c919bef6c2246d09144d054669ae200, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:00.886754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac553d9-0de0-4e98-80e7-5bcaa63b57d2 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:00.902353 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 451/897] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:45:00 2022] PUT /identity/v3/projects/29ac7081a0c44149a5d905d742bad0be/users/1c919bef6c2246d09144d054669ae200/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:45:02.980706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a35e0-5423-47e1-93d4-6a5c5e97220e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.981591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a35e0-5423-47e1-93d4-6a5c5e97220e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.981591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a35e0-5423-47e1-93d4-6a5c5e97220e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:02.984038 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 447/898] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:45:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:02.990331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:02.991012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:02.991198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.017977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:03.019177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:03.077042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.102550 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 452/899] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:45:03.367141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a35e0-5423-47e1-93d4-6a5c5e97220e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.477972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a35e0-5423-47e1-93d4-6a5c5e97220e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.491344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.513675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.514287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.514557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.514827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.525261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:45:03.530121 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:45:03.531062 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:45:03.532014 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 448/900] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:45:03.537998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.641437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6262d-4e08-404a-a67a-87f8254d3c04 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.676050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.676639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.676938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.677198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.677852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:03.678150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.679517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.687609 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 453/901] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:03.694521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.808969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75d6e6-31bb-411f-b319-cac2ff7b47c6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:03.844852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:03.845484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:03.845755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:03.846023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] PATH_INFO: `/v3/users/1c919bef6c2246d09144d054669ae200` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:03.847267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] RBAC: Authorizing `identity:get_user(user_id=1c919bef6c2246d09144d054669ae200)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:03.848712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:03.850386 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 449/902] 10.222.0.13 () {56 vars in 1177 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/users/1c919bef6c2246d09144d054669ae200 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:03.857267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:03.909698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:03.976577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd8b9-6362-462b-b771-e58ef86a9a0d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.011910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.012524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.012768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.013073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.087091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.088546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.129753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.190626 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 454/903] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:45:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:45:04.200215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.249351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:04.310660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf742-cfc0-446a-8509-eadd40d545b3 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.346651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.347259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.347531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.347794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] PATH_INFO: `/v3/projects/29ac7081a0c44149a5d905d742bad0be` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.348963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] RBAC: Authorizing `identity:get_project(project_id=29ac7081a0c44149a5d905d742bad0be)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.350405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bf5e8-e151-413c-9363-bc81aceaf554 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.352003 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 450/904] 10.222.0.13 () {56 vars in 1186 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/projects/29ac7081a0c44149a5d905d742bad0be => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:04.358654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:45:04.465551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed35b6-0288-41ce-a100-fa9da3cfb8df None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:45:04.500128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:45:04.500711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:04.501008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:04.501270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:04.501981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=29ac7081a0c44149a5d905d742bad0be, user.id=1c919bef6c2246d09144d054669ae200) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:45:04.502278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:45:04.503687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899273-41fe-44bf-a583-bd8461b0f02f None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:45:04.509434 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 455/905] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:45:04 2022] GET /identity/v3/role_assignments?user.id=1c919bef6c2246d09144d054669ae200&scope.project.id=29ac7081a0c44149a5d905d742bad0be&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:45:14.341683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=46 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:14.506854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:45:59.866232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002b82-e0b8-4ace-93d0-8e03520c6bc6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.866232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002b82-e0b8-4ace-93d0-8e03520c6bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.866232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4002b82-e0b8-4ace-93d0-8e03520c6bc6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.869411 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 451/906] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:45:59.875116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:45:59.875611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:45:59.875776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:45:59.896166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:45:59.897520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:45:59.980436 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 456/907] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:00.267716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002b82-e0b8-4ace-93d0-8e03520c6bc6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.400108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4002b82-e0b8-4ace-93d0-8e03520c6bc6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.443370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.444013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.444304 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.444747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.458881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.460403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:00.476446 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:00.484403 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:00.485633 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:00.485633 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:00.485633 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:00.485633 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 452/908] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:00.485884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.622605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fad6d-a7e9-4b41-92b0-f1d407a0bbca None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.656466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.663601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.664297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.664617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.664915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.665574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:00.665982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.667292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8b68-481f-4452-9e27-99e433b8b4d8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.691984 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 457/909] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:00.693075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:00.785008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:00.839452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47080519-f676-4480-9acf-56aac27aac33 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:00.879739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:00.880498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:00.880721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:00.881030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:00.883249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:00.883249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2861ab-9430-40ec-a1da-d59116d6e2d3 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:00.916869 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 453/910] 10.222.0.13 () {60 vars in 1132 bytes} [Sun Oct 16 00:46:00 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:03.364701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca02ec-cafd-4bc6-a42d-2af321b3a009 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.365323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca02ec-cafd-4bc6-a42d-2af321b3a009 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.365323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca02ec-cafd-4bc6-a42d-2af321b3a009 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.366660 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 458/911] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:03.372630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.373113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.373199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.396458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:03.397750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:03.471637 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 454/912] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:03.753592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca02ec-cafd-4bc6-a42d-2af321b3a009 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.879569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca02ec-cafd-4bc6-a42d-2af321b3a009 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:03.919606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:03.920230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:03.920474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:03.920740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:03.933123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:03.938901 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:03.939971 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:03.940796 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 459/913] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:03.946797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:03.990062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.055737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4133f06-e177-4386-895f-d8808b821c22 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.098946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.099555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.099828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.100091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.100753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.101083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.102491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.112341 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 455/914] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:04.120197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.174066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.229006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb5d03-23d2-4515-a497-cbc30fc72eb8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.269993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.271742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.271742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.271742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.283087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.285360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:04.304574 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.305972 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:04.306890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:04.306890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:04.306890 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:04.306890 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 460/915] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.312225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.426372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.430109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb5ae81-d5bc-45a8-b04b-a8befbdbad16 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.469578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.470258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.470570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.470840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.471507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.471815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.473442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.487980 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 456/916] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.493987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.602575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751c778-5f8a-4b06-8396-ad613bb156a3 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.604053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:04.638331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.638954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.639221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.639484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.647546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.649155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:04.660850 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:04.666964 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:04.668169 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 461/917] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:04.670019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.789827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf31d-81a4-4a8a-92a3-b99ab4660a7f None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:04.838284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:04.838891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:04.839167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:04.839430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:04.840159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:04.840457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:04.841926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:04.860778 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 457/918] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:04.866615 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:04.983088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5156b3c-2c71-449b-b3e3-4792103e7e8d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.023193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.023872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.024146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.024414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.035165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.036610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:05.052370 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:05.053598 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:05.055167 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:05.055167 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:05.055167 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:05.055167 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 462/919] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:05.061759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.082002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.170695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8739f-c2c0-44f5-87be-f585224c8c49 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.206524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.207208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.207495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.207789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.208533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.208939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.210465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.222349 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 458/920] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:05.228621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.245775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.337790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2eac3-4b42-4472-b642-c1a0e4d78b73 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.375862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.376491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.376759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.377046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.383571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.385084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:05.399622 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:05.400731 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:05.401859 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:05.404971 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 463/921] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:05.406652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.494561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.518640 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3f0a9-9c05-42e0-8d7e-b7b46a820aa5 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.555516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.556121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.556392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.556655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.557368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:05.557668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.559111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2e86d-422d-4f48-98e5-c9f858854ac0 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.572137 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 459/922] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:05.578352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:05.657766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:05.686793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4014-9196-445e-812e-95aa086da86a None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:05.723064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:05.723857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:05.724197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:05.724502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/410ef41768a448bda827bac4b6ba411b/roles/8ae1529e4b4c4232b3d5ce49404b1476` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:05.742617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=410ef41768a448bda827bac4b6ba411b, role_id=8ae1529e4b4c4232b3d5ce49404b1476)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:05.744320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dad61-2416-47be-902f-f2c81cabf087 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:05.759721 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 464/923] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:05 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/410ef41768a448bda827bac4b6ba411b/roles/8ae1529e4b4c4232b3d5ce49404b1476 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:46:08.062310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16cb64-876d-4d33-b8f0-ff8b3496cf29 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.062896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16cb64-876d-4d33-b8f0-ff8b3496cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.062896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16cb64-876d-4d33-b8f0-ff8b3496cf29 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.064189 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 460/924] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:08.069849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.070377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.070551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.089859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:08.091062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:08.164649 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 465/925] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:08.431150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16cb64-876d-4d33-b8f0-ff8b3496cf29 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.539713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16cb64-876d-4d33-b8f0-ff8b3496cf29 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.575774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.576403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.576673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.576967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.584533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.589455 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:08.594825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:08.595734 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:08.597578 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 461/926] 10.222.0.13 () {56 vars in 1102 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:08.602319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.660081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:08.709645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99286cdb-70f6-48f9-93db-5f33a91ca848 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.746712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.747330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.747601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.747857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.748560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:08.748884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.750296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.759002 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 466/927] 10.222.0.13 () {56 vars in 1103 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:08.765631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:08.867286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6511f2-926d-4f84-b63f-f5fe4b6c89f8 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:08.907744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:08.908392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:08.908635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:08.908929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:08.919531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:08.921057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:08.935421 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:08.936602 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:08.937576 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:08.937576 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:08.937576 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:08.937576 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 462/928] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:08.942990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.052081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ca7f-8102-4ad4-99f6-b85b2d997d56 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.069307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.090421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.091047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.091335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.091604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.092252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.092553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.093971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.108307 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 467/929] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:09.114863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.169114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.220520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b951a-2a89-4d90-a1d2-773028016fda None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.254550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.255174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.255467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.255706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.263287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.264712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:09.275667 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:09.276800 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:09.278032 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 463/930] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:09.282887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.386291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9d90-386e-4d93-807b-117d03eed2e7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.422375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.423172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.423472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.423765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.424552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:09.424954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.426477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.445514 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 468/931] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:09.451417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.557677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b3d29-b24d-4226-b3ac-25b2a2c1cdb6 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.569710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.595557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.596217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.596547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.596873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.667923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.669310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.776244 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 464/932] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:09.782894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.820675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:09.892418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d39cc-d051-4846-bcb4-baa4ed19afb5 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:09.927320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:09.927903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:09.928171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:09.928435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:09.938803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:09.940244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:09.955109 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:09.956236 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:09.957334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:09.957334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:09.957334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:09.957334 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 469/933] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:09.962238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:09.973707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.060960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84d276-5645-44e1-b53b-4df6ff26becf None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.099530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.100115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.100385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.100650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.101286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:10.101608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.102991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.114838 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 465/934] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:10.121251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.210283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.226400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6612355-5968-4af5-904f-388b5361c162 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.260376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.261044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.261315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.261628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.268260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.269745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:10.280612 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:10.281771 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:10.282974 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 470/935] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:10.289265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.362568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:10.395912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7044594-7da6-434f-bf1b-7e0127a4e87d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.434271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.434900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.435155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.435424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.436107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:10.436406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.437990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13aabc-7200-4921-a066-9fc7d7cc9fd4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.450939 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 466/936] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:10.457166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:10.564167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c643a94-3d83-42b2-bdf8-ea6e0cd413d8 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:10.599266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:10.600013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:10.600318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:10.600611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:10.601603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] RBAC: Adding query filter params (role.id=8ae1529e4b4c4232b3d5ce49404b1476, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=410ef41768a448bda827bac4b6ba411b) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:10.601918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:10.603525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f993051-ab98-4807-9abd-c65011398e16 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:10.610149 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 471/937] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:10 2022] GET /identity/v3/role_assignments?user.id=410ef41768a448bda827bac4b6ba411b&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=8ae1529e4b4c4232b3d5ce49404b1476 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:12.762836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb793b-3af3-4097-8c43-097b4507939a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.763610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb793b-3af3-4097-8c43-097b4507939a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.763610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb793b-3af3-4097-8c43-097b4507939a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.764725 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 467/938] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:12.770415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:12.770858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:12.770954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:12.791936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:12.793350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:12.796807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:12.868859 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 472/939] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:13.130871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb793b-3af3-4097-8c43-097b4507939a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.242408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb793b-3af3-4097-8c43-097b4507939a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.270500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.276404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.277055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.277326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.277623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.288503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:13.293487 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:13.294545 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:13.295490 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:13.300025 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 468/940] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:13.301403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.407084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9066-18e0-4024-93d9-d95918af98c2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.446758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.447375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.447650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.447916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.448575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:13.448926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.450277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.459771 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 473/941] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:13.465795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.578687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032fb4a-4a4d-4782-b247-b540c6aea680 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.618430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.619057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.619332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.619588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.629677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.631137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:13.645553 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:13.646563 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:13.647721 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:13.647721 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:13.647721 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:13.647721 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 469/942] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:13.653555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.656725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.766464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09266682-2de2-483d-81ff-c88318aec70e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.809540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.810231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.810510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.810775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.811418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:13.811716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.813119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:13.825703 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 474/943] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:13.831913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:13.877473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:13.943151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df807-de56-46af-a8f5-690d3f8671ed None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:13.977914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:13.978537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:13.978807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:13.979076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:13.987421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:13.988901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:14.000335 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.001485 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:14.002457 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 470/944] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:14.007578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.071114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.118717 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a273963-c763-4816-a548-39e52fefd50e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.160665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.161535 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.161897 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.162236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.163268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.163824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.165691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.186142 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 475/945] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:14.192283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.310784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede3560-b12f-4f8d-b28f-9a759be95084 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.312403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.348219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.348761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.349067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.349331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.360704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.362264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:14.376668 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.377825 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:14.378843 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:14.378843 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:14.378843 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:14.378843 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 471/946] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:14.384161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.496303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f6cf0-58f2-409f-ac2c-6508313e58d4 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.519792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:14.537798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.538605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.538879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.539249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.540157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.540518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.542587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.556768 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 476/947] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:14.562784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.668655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5604b-a071-4ea6-a947-d7c857f65494 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.710621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.711404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.711714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.711976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.719944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.721475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:14.735661 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:14.736776 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:14.737980 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:14.739851 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 472/948] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:14.746121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.862916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a606b0-84dd-4404-834e-678c4ac35d28 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:14.897426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:14.898053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:14.898324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:14.898588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:14.899267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:14.899565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:14.901021 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab55dfc-889b-49f3-967e-a16e60a254c6 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:14.915167 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 477/949] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:14.921529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:14.941116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:15.037608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a7b80-2cc2-48c7-9d44-74f36fda3055 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:15.073046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:15.073714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:15.074046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:15.074319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] PATH_INFO: `/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/410ef41768a448bda827bac4b6ba411b/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:15.076250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a862a0a8b49eca441fb45f9733419, user_id=410ef41768a448bda827bac4b6ba411b, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:15.077775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0aefa-1ce0-403a-b5f7-9b6fa5e19033 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:15.093601 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 473/950] 10.222.0.13 () {58 vars in 1439 bytes} [Sun Oct 16 00:46:14 2022] PUT /identity/v3/projects/2b5a862a0a8b49eca441fb45f9733419/users/410ef41768a448bda827bac4b6ba411b/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:46:17.223130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda1ce5-7127-4145-ab2b-9703753e3ab7 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.223790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda1ce5-7127-4145-ab2b-9703753e3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.223790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda1ce5-7127-4145-ab2b-9703753e3ab7 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.225214 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 478/951] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:17.231380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.231806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.231993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.251644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:17.253058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:17.330949 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 474/952] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:17.596691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda1ce5-7127-4145-ab2b-9703753e3ab7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.643940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.703873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda1ce5-7127-4145-ab2b-9703753e3ab7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.740232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.740881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.741154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.741422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.754701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 16 00:46:17.760745 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:17.761884 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:17.762759 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 479/953] 10.222.0.13 () {56 vars in 1096 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:17.768391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:17.771826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:17.872495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a090717-2c1a-48f3-b6cc-34ba4e4ee02b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:17.905352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:17.906009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:17.906268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:17.906517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:17.907171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:17.907467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:17.908865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:17.919353 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 475/954] 10.222.0.13 () {56 vars in 1099 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:17.925578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.033512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.036667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c786c6-61aa-4d7b-bc4b-66964b39478d None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.071458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.072091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.072359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.072622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.083397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.085036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:18.099351 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:18.100334 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:18.101352 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:18.101352 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:18.101352 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:18.101352 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 480/955] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:18.106948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.176411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.215876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d9d8-0dd5-4115-b8ec-e297ed4707b7 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.250402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.251158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.251402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.251708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.252434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.252822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.254410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.269814 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 476/956] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.275964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.376510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b5f2d-79af-4c50-b079-7e180bb35edb None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.411028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.411672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.412015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.412333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.419996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.421505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 16 00:46:18.432779 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:18.433926 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:18.435069 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 481/957] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:18.440105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.547028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf1e9e-f250-430b-9da6-2ad2fc66bff4 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.571757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.581467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.582066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.582339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.582608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.583327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:18.583634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.585114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.602895 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 477/958] 10.222.0.13 () {56 vars in 1143 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:18.609485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:18.625530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.714075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46872b3c-65e1-4946-9018-83b0cff8412e None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:18.748247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:18.749046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:18.749352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:18.749672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:18.833023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:18.834563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:18.851896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:18.947323 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 482/959] 10.222.0.13 () {58 vars in 1282 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 16 00:46:18.953651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.061360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a1bed-78e5-403e-94ff-e3f5b75b1e15 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.100057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.100706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.101032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.101365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.112278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.113776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 16 00:46:19.130550 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.131742 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 16 00:46:19.133115 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 16 00:46:19.133115 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 16 00:46:19.133115 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:19.133115 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 478/960] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 16 00:46:19.138390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.252197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250de10-9c15-4948-a10c-32885b02d3a0 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.267257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.290743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.291583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.292369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.292369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.292560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.292791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.294174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.305860 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 483/961] 10.222.0.13 () {56 vars in 1109 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:19.311782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.349754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.422511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff57a9-2649-4107-94bc-c03640177881 None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.457384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.458028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.458306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.458562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.466524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.468021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 16 00:46:19.480886 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:19.482283 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: ERROR keystone.server.flask.application Oct 16 00:46:19.483198 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 479/962] 10.222.0.13 () {56 vars in 1111 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:19.488702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.603842 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6906261-d782-4472-a7ca-ce5998bf2473 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.642063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.642665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.642916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.643207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.643907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.644221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.645726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11dba62-e9e6-403b-982b-b2d97f89cdf4 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.659450 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 484/963] 10.222.0.13 () {56 vars in 1148 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:19.665967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:19.774432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:19.783703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111494-3e93-4969-8f33-86cfe30a3efc None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:19.820045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:19.820680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:19.821016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:19.821282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:19.821998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] RBAC: Adding query filter params (role.id=38fd9e343b93477a8dbf3d1c2a3799c4, scope.project.id=2b5a862a0a8b49eca441fb45f9733419, user.id=410ef41768a448bda827bac4b6ba411b) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:19.822299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:19.823742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae191b4-69f9-4c79-8ae9-8751bdb65775 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:19.829561 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 480/964] 10.222.0.13 () {56 vars in 1374 bytes} [Sun Oct 16 00:46:19 2022] GET /identity/v3/role_assignments?user.id=410ef41768a448bda827bac4b6ba411b&scope.project.id=2b5a862a0a8b49eca441fb45f9733419&role.id=38fd9e343b93477a8dbf3d1c2a3799c4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:21.997050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ac7-a310-4c6b-b3e0-820de02a90d5 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:21.997905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ac7-a310-4c6b-b3e0-820de02a90d5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:21.997905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad7ac7-a310-4c6b-b3e0-820de02a90d5 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.000033 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 485/965] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:22.006383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.007087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.007235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.032345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:22.033567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:22.106553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 481/966] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:22.371523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad7ac7-a310-4c6b-b3e0-820de02a90d5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:22.407079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:22.481191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad7ac7-a310-4c6b-b3e0-820de02a90d5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:22.529165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:22.529787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.530065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.530334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.530906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:22.532281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:22.541873 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:22.543022 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:22.544021 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 486/967] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:22.549525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:22.652909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:22.663822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54f624-675f-4987-a25d-92efa29f8403 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:22.698715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:22.699322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.699592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.699847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.700465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:22.700760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:22.702155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bc500-d4e0-4dc6-96b4-6e4c7bcf7ee8 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:22.707017 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 482/968] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 16 00:46:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:46:22.714145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:22.826569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:22.832710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74bb6-1510-4c55-bf1d-4fe9f734973c None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:22.867230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:22.867830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:22.868103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:22.868384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] PATH_INFO: `/v3/services` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:22.869036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:22.869337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:22.870713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7582-d90e-4230-a569-deafcefee955 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:22.875210 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 487/969] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 16 00:46:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:25.105287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f288-6b3e-4c9f-a42d-6ab2e0c7d715 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.106128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f288-6b3e-4c9f-a42d-6ab2e0c7d715 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.106128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f288-6b3e-4c9f-a42d-6ab2e0c7d715 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.107513 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 483/970] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:25.112967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973bbd-9528-4c12-a0d4-0865eecae407 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.113420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973bbd-9528-4c12-a0d4-0865eecae407 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.113513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88973bbd-9528-4c12-a0d4-0865eecae407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.134257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-88973bbd-9528-4c12-a0d4-0865eecae407 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:25.135443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-88973bbd-9528-4c12-a0d4-0865eecae407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:25.217917 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 488/971] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:25.483073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f288-6b3e-4c9f-a42d-6ab2e0c7d715 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:25.594480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f288-6b3e-4c9f-a42d-6ab2e0c7d715 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:25.629896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:25.630484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:25.630723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:25.631022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:25.631660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:25.633119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc26a21-5558-471b-b102-af3a09c71148 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:25.652258 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 484/972] 10.222.0.13 () {60 vars in 1141 bytes} [Sun Oct 16 00:46:25 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:27.779050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9ad7-0802-4e1a-86bf-0c1ea6d41bcb None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.779840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9ad7-0802-4e1a-86bf-0c1ea6d41bcb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.779840 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a9ad7-0802-4e1a-86bf-0c1ea6d41bcb None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.781180 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 489/973] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:27.786880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:27.787344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:27.787440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:27.807444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:27.808776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:27.818763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:27.884120 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 485/974] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:28.149375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a9ad7-0802-4e1a-86bf-0c1ea6d41bcb None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.257767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:28.269025 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a9ad7-0802-4e1a-86bf-0c1ea6d41bcb None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.306938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.307558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.307832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.308100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.308674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.310089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:28.319868 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:28.321235 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:28.322313 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 490/975] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:28.327280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.428160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d95e4-af06-42ca-a59e-5e87e355a812 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.463742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.464333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.464607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.464877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.465521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:28.465813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.467189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.472481 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 486/976] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:28.478544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.584398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112b91c-d152-44e0-b0a5-9f7cfd4430f7 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.620585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.621204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.621476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.621734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.622432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] RBAC: Adding query filter params (interface=public, service_id=0aebbfb4f64a493093693d68ac2d6b80, region_id=RegionOne) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:28.622731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.624073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd2831-53a5-490b-8ac5-b2999310621e None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.629109 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 491/977] 10.222.0.13 () {56 vars in 1251 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/endpoints?service_id=0aebbfb4f64a493093693d68ac2d6b80&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:28.636135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:28.640550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:28.735790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0d34b-ad08-4626-a3dd-eaa10e17311d None admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:28.781928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:28.782534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:28.782810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:28.783077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:28.783672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:28.785081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de82a15-8cd2-421b-bc6f-bb46c1d78e8c None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:28.791981 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 487/978] 10.222.0.13 () {56 vars in 1087 bytes} [Sun Oct 16 00:46:28 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:46:30.899927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4ebc-db9c-4ff3-afde-ba1f8a6bee91 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.900516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4ebc-db9c-4ff3-afde-ba1f8a6bee91 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.900516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4ebc-db9c-4ff3-afde-ba1f8a6bee91 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.901841 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 492/979] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:46:30.908247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:30.909031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:30.909188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:30.936096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:46:30.937332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:46:31.004707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.010865 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 488/980] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:46:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 16 00:46:31.279619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4ebc-db9c-4ff3-afde-ba1f8a6bee91 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.301211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.387943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4ebc-db9c-4ff3-afde-ba1f8a6bee91 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.422720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.423270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.423541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.423805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.424376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.425795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 16 00:46:31.434823 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 16 00:46:31.435958 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.get_or_create( Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application with Lock( Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self._enter() Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application return self.creator() Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application created_value = creator( Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: ERROR keystone.server.flask.application Oct 16 00:46:31.437027 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 493/981] 10.222.0.13 () {56 vars in 1117 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 16 00:46:31.442617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.549264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01dde-6306-40c6-919b-4693c97d8ce2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.584203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.584818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.585129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.585394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.586014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:46:31.586307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.587677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e000c-3515-45fa-808c-c24793212ba6 None admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.592769 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 489/982] 10.222.0.13 () {56 vars in 1116 bytes} [Sun Oct 16 00:46:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:46:31.598589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:46:31.683892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:31.705863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa21bd-f09e-4f6e-a1f8-63e436509d46 None admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:46:31.741264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:46:31.741918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:46:31.742212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:46:31.742489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:46:31.743231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:46:31.744800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c0767-2ce3-4eac-9908-cec1284e1e64 None admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:46:31.774326 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 494/983] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:46:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:46:41.589749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=69 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:46:41.767247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:35.378906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ccf5-7b13-419b-9749-70753e4c8d0c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.379414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ccf5-7b13-419b-9749-70753e4c8d0c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.379414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1ccf5-7b13-419b-9749-70753e4c8d0c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.381110 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 490/984] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:35.385833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b580-46be-45b0-aef8-01c9e5824b16 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.386251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b580-46be-45b0-aef8-01c9e5824b16 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.386434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39b580-46be-45b0-aef8-01c9e5824b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.470090 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4c39b580-46be-45b0-aef8-01c9e5824b16 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:35.471441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4c39b580-46be-45b0-aef8-01c9e5824b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:35.604406 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 495/985] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:35.898090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.898377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.898818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:35.900333 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 491/986] 10.222.0.13 () {54 vars in 964 bytes} [Sun Oct 16 00:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:35.907130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d72a-3b72-4297-a4ef-df10a3f0806f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:35.907699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d72a-3b72-4297-a4ef-df10a3f0806f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:35.908138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7d72a-3b72-4297-a4ef-df10a3f0806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.001265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fbc7d72a-3b72-4297-a4ef-df10a3f0806f None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:36.002775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fbc7d72a-3b72-4297-a4ef-df10a3f0806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:36.027443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.089139 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 496/987] 10.222.0.13 () {58 vars in 1061 bytes} [Sun Oct 16 00:47:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:47:36.098685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:36.100437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:36.212757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75f941-c1de-478b-a8ab-ff8efe5464d2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:36.289478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:36.290491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:36.290767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:36.291031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:36.292637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:36.350731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:36.408336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:36.409836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4f019-3f20-489e-85d6-a948a8198577 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:36.429126 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 492/988] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:47:38.838086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:38.838663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:38.838663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:38.840309 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 497/989] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:38.845575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c485-8349-4785-af83-43a8cca14cf3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:38.845997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c485-8349-4785-af83-43a8cca14cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:38.846084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c485-8349-4785-af83-43a8cca14cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:38.926847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1033c485-8349-4785-af83-43a8cca14cf3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:38.927989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1033c485-8349-4785-af83-43a8cca14cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:39.027949 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 493/990] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:39.307377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:39.308969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:39.420320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e99aa0-e5fc-490a-b7e3-c429f958a530 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:39.499196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:39.501647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:39.502280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:39.502562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:39.503169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:39.505694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:39.631463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:39.632923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63ce4-1a19-4507-aba5-6d88572d5f59 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:39.651606 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 498/991] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:42.088890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:42.089668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:42.089848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:42.091992 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 494/992] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:42.097455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e388a-8968-4a09-a891-271361c9589b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:42.097903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e388a-8968-4a09-a891-271361c9589b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:42.097995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e388a-8968-4a09-a891-271361c9589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:42.164433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1b6e388a-8968-4a09-a891-271361c9589b None None] MFA Rules not processed for user `771d44da2ee847eabd7802b16a03e281`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:42.165678 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1b6e388a-8968-4a09-a891-271361c9589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:42.220594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:42.272133 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 499/993] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:42.552824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:42.555325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:42.570324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:42.675916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abb251-1d4b-4019-ac42-37872d1cb760 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:42.753124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:42.753820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:42.754092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:42.754362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:42.755972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:42.819727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:42.869878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:42.871316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcd540-def3-413a-9231-299287faafbe service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:42.890757 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 495/994] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:45.515688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:45.516235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:45.516235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:45.517639 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 500/995] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:45.524046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec10-9326-4ace-a021-ea686b40c1c8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:45.524787 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec10-9326-4ace-a021-ea686b40c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:45.525005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec10-9326-4ace-a021-ea686b40c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:45.595655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e864ec10-9326-4ace-a021-ea686b40c1c8 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:45.596871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e864ec10-9326-4ace-a021-ea686b40c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:45.706348 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 496/996] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:45.999026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:46.001524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:46.125522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb956-f63b-4907-ba5c-06e2ab72b5ae None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:46.200441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:46.201054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:46.201352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:46.201611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:46.203215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:46.210398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:46.322798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:46.324275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0807b-9037-4180-a16f-56cb57150638 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:46.343225 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 501/997] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:49.132178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.132766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.132766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.134119 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 497/998] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:49.139546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b75f-483c-45c1-a65c-40811d3d424e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.139980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b75f-483c-45c1-a65c-40811d3d424e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.140309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4b75f-483c-45c1-a65c-40811d3d424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.216930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-aaf4b75f-483c-45c1-a65c-40811d3d424e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:49.218181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aaf4b75f-483c-45c1-a65c-40811d3d424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:49.281943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.323614 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 502/999] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:49.601564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:49.603105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:49.624426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.711475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1476d9-5013-43c8-ad1e-f2e558550881 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:49.787274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:49.787876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:49.788146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:49.788410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:49.790058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:49.861978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:49.901639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:49.903128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e57ae8-f2fa-451b-a72d-318e28e96ac3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:49.921291 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 498/1000] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:52.092607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:52.093134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:52.093134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:52.094526 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 503/1001] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:52.100121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be98cd-be73-41e9-8342-73be96a4453a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:52.100523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be98cd-be73-41e9-8342-73be96a4453a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:52.100693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be98cd-be73-41e9-8342-73be96a4453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:52.168407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82be98cd-be73-41e9-8342-73be96a4453a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:52.169620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82be98cd-be73-41e9-8342-73be96a4453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:52.275262 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 499/1002] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:52.551482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:52.553087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:52.659982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf6ffc-76be-4441-b76f-1877e40d1ffc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:52.734309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:52.734925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:52.735201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:52.735448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:52.737080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:52.755155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:52.852082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:52.853906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ac75f-feb1-4377-b124-f9a0e28796a1 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:52.873568 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 504/1003] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:55.064459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6e32-5ed1-4935-b4ce-95c6d606763e None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:55.064995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6e32-5ed1-4935-b4ce-95c6d606763e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:55.065100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd6e32-5ed1-4935-b4ce-95c6d606763e None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:55.066480 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 500/1004] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:55.071944 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402202-edfc-43cc-8bd2-6e4582263ebe None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:55.072399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402202-edfc-43cc-8bd2-6e4582263ebe None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:55.072498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402202-edfc-43cc-8bd2-6e4582263ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:55.144107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-82402202-edfc-43cc-8bd2-6e4582263ebe None None] MFA Rules not processed for user `771d44da2ee847eabd7802b16a03e281`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:55.145343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-82402202-edfc-43cc-8bd2-6e4582263ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:55.212191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:55.246637 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 505/1005] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:55.537696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:55.537983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:55.538622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:55.539601 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 501/1006] 10.222.0.13 () {54 vars in 964 bytes} [Sun Oct 16 00:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:55.545738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f746b2-86eb-4fa3-812d-b3ba1fe5830d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:55.546019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f746b2-86eb-4fa3-812d-b3ba1fe5830d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:55.546284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f746b2-86eb-4fa3-812d-b3ba1fe5830d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:55.624165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-44f746b2-86eb-4fa3-812d-b3ba1fe5830d None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:55.625327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-44f746b2-86eb-4fa3-812d-b3ba1fe5830d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:55.702850 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 506/1007] 10.222.0.13 () {58 vars in 1061 bytes} [Sun Oct 16 00:47:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:55.711947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:55.713510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:55.745761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:55.818795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c59d26-c688-403c-ae50-aba78fc5dad0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:55.895256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:55.895786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:55.896065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:55.896336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:55.897985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:55.975964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:56.012476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:56.013993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5ce13-3da7-459a-8b24-d6ec5f6b9dfa service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:56.031727 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 502/1008] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:47:58.743835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:58.744681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:58.744681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:58.746842 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 507/1009] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:47:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:47:58.752621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd57f1-9744-4d94-84b1-a6eedbcb7cd0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:58.753124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd57f1-9744-4d94-84b1-a6eedbcb7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:58.753373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd57f1-9744-4d94-84b1-a6eedbcb7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:58.822936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-21cd57f1-9744-4d94-84b1-a6eedbcb7cd0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:47:58.824133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-21cd57f1-9744-4d94-84b1-a6eedbcb7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:58.926143 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 503/1010] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:47:59.207697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:47:59.210311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:59.287972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:59.322965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9687b88-8078-4394-ac77-7ae2d9d3cfdc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:47:59.400618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:47:59.401251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:47:59.401517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:47:59.401774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:47:59.403352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:47:59.516798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:47:59.518252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3114f-03f1-4fa6-9e1a-443998f1b859 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:47:59.528321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:47:59.537100 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 508/1011] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:01.715509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:01.716148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:01.716148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:01.717419 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 504/1012] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:01.724087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9d6b-62bc-4c35-b11e-69cccc2c6054 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:01.724939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9d6b-62bc-4c35-b11e-69cccc2c6054 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:01.724939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9d6b-62bc-4c35-b11e-69cccc2c6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:01.797953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-836d9d6b-62bc-4c35-b11e-69cccc2c6054 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:01.799154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-836d9d6b-62bc-4c35-b11e-69cccc2c6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:01.900517 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 509/1013] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:02.189576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:02.191310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:02.234050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:02.301767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49466-c110-434d-b1de-23ad3a26434a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:02.385963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:02.386559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:02.386829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:02.387088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:02.388680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:02.473586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:02.499927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:02.501402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34894409-5e8f-4052-b985-d29339dc9434 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:02.519762 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 505/1014] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:05.105000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:05.105512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:05.105512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:05.106878 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 510/1015] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:05.112364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364892-ddba-4860-bebb-5e1d3486be28 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:05.112786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364892-ddba-4860-bebb-5e1d3486be28 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:05.112922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b364892-ddba-4860-bebb-5e1d3486be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:05.181621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7b364892-ddba-4860-bebb-5e1d3486be28 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:05.182806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7b364892-ddba-4860-bebb-5e1d3486be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:05.280320 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 506/1016] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:05.560003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:05.562550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:05.651757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:05.681883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cae32-766d-42f0-ab8f-66aa16c88fa0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:05.768444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:05.769090 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:05.769396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:05.769653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:05.771262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:05.887430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:05.888881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b799-0c74-45f5-b418-a4bc1275c0e4 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:05.907744 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 511/1017] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:10.056958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:10.057516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:10.057516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:10.058858 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 507/1018] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:10.064471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ee96-4c5a-46d6-8b0f-d1201dc8f9ce None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:10.064981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ee96-4c5a-46d6-8b0f-d1201dc8f9ce None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:10.065143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f25ee96-4c5a-46d6-8b0f-d1201dc8f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:10.070880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:10.140788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8f25ee96-4c5a-46d6-8b0f-d1201dc8f9ce None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:10.141952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8f25ee96-4c5a-46d6-8b0f-d1201dc8f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:10.243470 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 512/1019] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:10.520494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:10.522121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:10.570918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:10.628268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021a11-ef56-4fda-b8be-a00de66d27e4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:10.704016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:10.704621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:10.704920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:10.705193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:10.706848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:10.802899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:10.819629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:10.821120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76862dfd-69e5-436f-b21d-cb790582faa7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:10.840714 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 508/1020] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:13.573359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:13.573962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:13.573962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:13.575264 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 513/1021] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:13.580617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342b9a-8f32-4e65-92f2-cb3e552071b1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:13.581086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342b9a-8f32-4e65-92f2-cb3e552071b1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:13.581323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342b9a-8f32-4e65-92f2-cb3e552071b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:13.649820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5f342b9a-8f32-4e65-92f2-cb3e552071b1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:13.651090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5f342b9a-8f32-4e65-92f2-cb3e552071b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:13.748792 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 509/1022] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:14.030363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:14.031923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:14.127616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:14.148287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e45e-2b9b-4566-9c99-06c010c89611 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:14.223999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:14.224658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:14.224966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:14.225228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:14.226806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:14.337074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:14.338428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1922141-9c53-4763-a7aa-24928fc06e5d service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:14.359568 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 514/1023] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:18.440361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:18.440863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:18.441203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:18.442759 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 510/1024] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:18.448277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ebcd6-f873-45ed-8abd-109a86b704b3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:18.448701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ebcd6-f873-45ed-8abd-109a86b704b3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:18.448779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ebcd6-f873-45ed-8abd-109a86b704b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:18.464993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:18.517517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-434ebcd6-f873-45ed-8abd-109a86b704b3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:18.518736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-434ebcd6-f873-45ed-8abd-109a86b704b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:18.623100 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 515/1025] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:18.899076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:18.900913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:18.957331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:19.006744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d785fa-a40c-488a-a60a-2c873ad3c3f1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:19.081187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:19.081792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:19.082053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:19.082298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:19.084097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:19.199805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:19.204099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:19.205770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa1058-d296-4b03-a866-54bfe5d1ac89 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:19.223474 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 511/1026] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:24.139010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3feb-4f6d-442b-95ed-1f900f1da8a1 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:24.139548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3feb-4f6d-442b-95ed-1f900f1da8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:24.139548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd3feb-4f6d-442b-95ed-1f900f1da8a1 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:24.141278 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 516/1027] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:24.146329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500daa-1333-4534-9a9f-cd0412f2a90b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:24.146717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500daa-1333-4534-9a9f-cd0412f2a90b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:24.146869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae500daa-1333-4534-9a9f-cd0412f2a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:24.251978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ae500daa-1333-4534-9a9f-cd0412f2a90b None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:24.253458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ae500daa-1333-4534-9a9f-cd0412f2a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:24.401904 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 512/1028] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:28.515735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad62a24-10ca-4dd8-a0a4-0c14272f093b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:28.516264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad62a24-10ca-4dd8-a0a4-0c14272f093b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:28.516264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad62a24-10ca-4dd8-a0a4-0c14272f093b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:28.517987 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 517/1029] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:28.523277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf5f8-8412-48c3-b765-5359c8d9f612 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:28.523748 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf5f8-8412-48c3-b765-5359c8d9f612 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:28.523848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baf5f8-8412-48c3-b765-5359c8d9f612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:28.579784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:28.605013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b4baf5f8-8412-48c3-b765-5359c8d9f612 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:28.606226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b4baf5f8-8412-48c3-b765-5359c8d9f612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:28.621330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=59 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:28.717875 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 513/1030] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:30.025485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa887-c72e-4543-813d-488864e00937 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:30.026079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa887-c72e-4543-813d-488864e00937 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:30.026079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fa887-c72e-4543-813d-488864e00937 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:30.027332 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 518/1031] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:30.032548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297123-e465-4746-bc66-4730aa14b007 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:30.033045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297123-e465-4746-bc66-4730aa14b007 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:30.033157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297123-e465-4746-bc66-4730aa14b007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:30.116138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-04297123-e465-4746-bc66-4730aa14b007 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:30.117423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-04297123-e465-4746-bc66-4730aa14b007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:30.160111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:30.226272 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 514/1032] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:33.760719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a449-d1bc-4d32-9d0e-0cb13c65ff7a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.761294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a449-d1bc-4d32-9d0e-0cb13c65ff7a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.761294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559a449-d1bc-4d32-9d0e-0cb13c65ff7a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.767186 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 519/1033] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:33.768408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b346-b1d3-4af6-a14e-0066fe0928b3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:33.768901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b346-b1d3-4af6-a14e-0066fe0928b3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:33.769080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8b346-b1d3-4af6-a14e-0066fe0928b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:33.841505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-36a8b346-b1d3-4af6-a14e-0066fe0928b3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:33.842734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-36a8b346-b1d3-4af6-a14e-0066fe0928b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:33.945605 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 515/1034] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:34.242515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:34.243742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:34.244346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:34.246080 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 520/1035] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:34.254394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206872c3-5797-4600-8f0a-6edc755ce491 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:34.254682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206872c3-5797-4600-8f0a-6edc755ce491 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:34.254959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206872c3-5797-4600-8f0a-6edc755ce491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:34.277811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:34.345695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-206872c3-5797-4600-8f0a-6edc755ce491 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:34.346992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-206872c3-5797-4600-8f0a-6edc755ce491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:34.466104 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 516/1036] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:34.474801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:34.476401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:34.631134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf9642-01a0-4cc2-a9a5-9baf40a5216d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:34.707543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:34.749995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:34.750615 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:34.750993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:34.751353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:34.753109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:34.845983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:34.847812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc628-d548-4b83-8259-9db90dff318c service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:34.870469 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 521/1037] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:37.236596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.237166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.237166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.238410 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 517/1038] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:37.244052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51596-48ae-4e22-80e1-1ea5eeef7100 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:37.245287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51596-48ae-4e22-80e1-1ea5eeef7100 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:37.246027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c51596-48ae-4e22-80e1-1ea5eeef7100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:37.353611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f9c51596-48ae-4e22-80e1-1ea5eeef7100 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:37.354819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f9c51596-48ae-4e22-80e1-1ea5eeef7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:37.399883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.461282 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 522/1039] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:37.749691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:37.751641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:37.821150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:37.930456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b762527-4bba-4caf-abf5-fb54defe94a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:38.052317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:38.052964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:38.053256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:38.053508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:38.055117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:38.078211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:38.152374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:38.154025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81fefe-c97a-478b-a04f-6fb481ddce0f service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:38.172199 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 518/1040] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:40.620034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce45e-7f9d-4779-a4db-a8bb7e969fce None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:40.620616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce45e-7f9d-4779-a4db-a8bb7e969fce None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:40.620616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce45e-7f9d-4779-a4db-a8bb7e969fce None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:40.622105 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 523/1041] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:40.627420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ebfa8-77b5-4e09-8d46-04437654538c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:40.627817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ebfa8-77b5-4e09-8d46-04437654538c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:40.628016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ebfa8-77b5-4e09-8d46-04437654538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:40.699921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3e3ebfa8-77b5-4e09-8d46-04437654538c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:40.701327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e3ebfa8-77b5-4e09-8d46-04437654538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:40.811567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:40.821353 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 519/1042] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:41.100629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.101185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.101780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.103712 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 524/1043] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:41.109333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2db2d-3bf4-4575-a9f2-f8f245637f32 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.109682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2db2d-3bf4-4575-a9f2-f8f245637f32 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.110034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2db2d-3bf4-4575-a9f2-f8f245637f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.194727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3ef2db2d-3bf4-4575-a9f2-f8f245637f32 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:41.195980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ef2db2d-3bf4-4575-a9f2-f8f245637f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:41.315229 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 520/1044] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:41.323882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:41.325812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:41.484863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b82e3-f740-45e4-9cd4-57a9e9233cb7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:41.505267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:41.603597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:41.604183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.604452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.604738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.606369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:41.704484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:41.706136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0ca13-fcb1-461f-96d0-e91c77eaca53 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:41.725632 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 525/1045] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:41.794863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8226-9b85-4c48-8441-b87a2b813ea7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.795404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8226-9b85-4c48-8441-b87a2b813ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.795404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f8226-9b85-4c48-8441-b87a2b813ea7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.796971 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 521/1046] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:41.802505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d691ec-2cbd-4617-8e73-6247b352b1fd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:41.802786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d691ec-2cbd-4617-8e73-6247b352b1fd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:41.803055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d691ec-2cbd-4617-8e73-6247b352b1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:41.843942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:41.888299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-97d691ec-2cbd-4617-8e73-6247b352b1fd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:41.889570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-97d691ec-2cbd-4617-8e73-6247b352b1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:42.013521 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 526/1047] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:42.340823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.341105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.341381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.342704 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 522/1048] 10.222.0.13 () {54 vars in 963 bytes} [Sun Oct 16 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:42.348070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c451ce-0bff-4461-b5df-9426172b3f53 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.348353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c451ce-0bff-4461-b5df-9426172b3f53 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.348620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c451ce-0bff-4461-b5df-9426172b3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.440457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-03c451ce-0bff-4461-b5df-9426172b3f53 None None] MFA Rules not processed for user `f1f42430209d4ae9b1c0d039e1797a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:42.441687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-03c451ce-0bff-4461-b5df-9426172b3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:42.498430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.534954 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 527/1049] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 16 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:42.543325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:42.544882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:42.601460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.667447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e07dc9-dd45-4d5b-97da-eb17e24f30d5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:42.755762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:42.756775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:42.757256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:42.757881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:42.759952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:42.865185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:42.879779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:42.881283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fba46-4240-494d-a2e0-7dc25d021554 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:42.900253 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 523/1050] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:43.942715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:43.943285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:43.943285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:43.944741 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 528/1051] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:43.950134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ace56-2bc5-45d0-9564-336261778447 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:43.950528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ace56-2bc5-45d0-9564-336261778447 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:43.950766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ace56-2bc5-45d0-9564-336261778447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:44.020061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0f7ace56-2bc5-45d0-9564-336261778447 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:44.021301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0f7ace56-2bc5-45d0-9564-336261778447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:44.127067 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 524/1052] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:44.413480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:44.415033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:44.575568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd77cdc-39d0-48d9-81ad-eb18f4c9b599 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:44.626794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:44.690630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:44.691236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:44.691509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:44.691766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:44.693378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:44.786981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:44.788578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce4831-3f6d-439c-b1e2-626ef7fbda52 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:44.807757 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 529/1053] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:47.010220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.010788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.010788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.012164 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 525/1054] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:47.017807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164499-7780-4206-8cea-dd2214844943 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.018306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164499-7780-4206-8cea-dd2214844943 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.018306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164499-7780-4206-8cea-dd2214844943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.094027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-50164499-7780-4206-8cea-dd2214844943 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:47.095627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-50164499-7780-4206-8cea-dd2214844943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:47.105786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.203606 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 530/1055] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:47.485815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:47.487322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:47.549005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.634689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b76bbe-0d2c-4d38-9d8c-d2799a07f97b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:47.749947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:47.750481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:47.750808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:47.751071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:47.752636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:47.773490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:47.847902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:47.849661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2ec3d-9d44-4d11-80d2-b25dc497ff1a service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:47.868288 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 526/1056] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:50.078589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:50.079449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:50.079947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:50.081917 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 531/1057] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:50.088336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716031-d13f-4f2b-8457-954b38a8d075 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:50.088730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716031-d13f-4f2b-8457-954b38a8d075 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:50.089003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716031-d13f-4f2b-8457-954b38a8d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:50.177113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bd716031-d13f-4f2b-8457-954b38a8d075 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:50.178325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bd716031-d13f-4f2b-8457-954b38a8d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:50.276073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:50.282122 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 527/1058] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:50.573735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:50.575312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:50.719452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:50.731513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d082da8-e0ad-44b8-a59f-0c6013ecdfe4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:50.870149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:50.870695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:50.870966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:50.871237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:50.872997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:50.972193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:50.974466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1420f2-9f61-4d4a-a4a2-95b5e4f9e30e service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:50.988830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:51.000637 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 532/1059] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:53.399876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:53.400459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:53.400459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:53.401977 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 528/1060] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:53.408826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debee2-a879-4be5-9c59-8336b45485da None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:53.409293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debee2-a879-4be5-9c59-8336b45485da None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:53.409570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35debee2-a879-4be5-9c59-8336b45485da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:53.493712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-35debee2-a879-4be5-9c59-8336b45485da None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:53.495361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-35debee2-a879-4be5-9c59-8336b45485da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:53.601183 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 533/1061] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:53.896986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:53.898656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:54.054009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1c86a-15bd-4897-bccc-c5ff1911be25 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:54.132466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:54.181053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:54.181694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:54.181974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:54.182239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:54.183914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:54.278903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:54.280858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83459b3-ec8e-4ec0-8f70-a0891f25ed39 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:54.302118 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 529/1062] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:56.520515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:56.521120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:56.521120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:56.522571 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 534/1063] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:56.528595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191089-0fe8-48ab-8336-03b4fdc6162f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:56.529043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191089-0fe8-48ab-8336-03b4fdc6162f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:56.529212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56191089-0fe8-48ab-8336-03b4fdc6162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:56.600706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-56191089-0fe8-48ab-8336-03b4fdc6162f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:56.602320 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56191089-0fe8-48ab-8336-03b4fdc6162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:56.636678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:56.710177 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 530/1064] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:48:57.010666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:48:57.012723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:57.116065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:57.193526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa67d-0c6f-409c-a50c-e0bcf47ee42b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:48:57.328024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:48:57.328980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:57.329268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:57.329618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:57.331507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:57.380016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:48:57.433035 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:48:57.434724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5b3ea-2e8f-4d59-9f36-951e50568f4b service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:48:57.452696 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 535/1065] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:48:59.689646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:59.690240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:59.690240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:59.691562 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 531/1066] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:48:59.697088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da502-1568-4243-ac19-e162fa546806 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:48:59.697549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da502-1568-4243-ac19-e162fa546806 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:48:59.697656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da502-1568-4243-ac19-e162fa546806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:48:59.766045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d80da502-1568-4243-ac19-e162fa546806 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:48:59.767263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d80da502-1568-4243-ac19-e162fa546806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:48:59.867162 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 536/1067] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:00.152554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:00.154144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:00.177064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a800-07d5-4de5-b9ae-aff9e76562a4 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.177322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a800-07d5-4de5-b9ae-aff9e76562a4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.177645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801a800-07d5-4de5-b9ae-aff9e76562a4 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.179209 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 537/1068] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:49:00.184827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274167b-e4f6-46ce-a770-9c839d079c1b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.185143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274167b-e4f6-46ce-a770-9c839d079c1b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.185418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274167b-e4f6-46ce-a770-9c839d079c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.202034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.256645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6274167b-e4f6-46ce-a770-9c839d079c1b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:00.257886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6274167b-e4f6-46ce-a770-9c839d079c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:00.309661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7095895-adb4-44d8-8023-2f10289dbcdb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:00.327585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.355405 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 538/1069] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:49:00.430059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:00.430684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.430964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.431230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.432858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:00.525146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:00.526756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880f720-9b92-48fb-bf65-4c4fe4ff7292 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:00.544957 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 532/1070] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:00.649051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.649337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.649606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.651030 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 539/1071] 10.222.0.13 () {54 vars in 962 bytes} [Sun Oct 16 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:00.658059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6e037-bb10-4cb3-af38-1faa8992e8d9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:00.658346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6e037-bb10-4cb3-af38-1faa8992e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:00.659063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6e037-bb10-4cb3-af38-1faa8992e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:00.687542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.745990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-99c6e037-bb10-4cb3-af38-1faa8992e8d9 None None] MFA Rules not processed for user `1f1ad7b6fd7e432c9b56d2a5bad33854`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:00.747210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-99c6e037-bb10-4cb3-af38-1faa8992e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:00.825191 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 533/1072] 10.222.0.13 () {58 vars in 1059 bytes} [Sun Oct 16 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:00.834379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:00.835887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:00.938120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:00.945480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca93b-438f-46b0-92d6-618fe285c065 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:01.022982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:01.023606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.023876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.024140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.025754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:01.144489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:01.145967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90f506-f0a1-4e62-9d26-253597ca8a0f service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:01.164433 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 540/1073] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:01.914797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462eb0e-bc57-42fa-85ab-55eed07f0850 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:01.915261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462eb0e-bc57-42fa-85ab-55eed07f0850 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:01.915261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462eb0e-bc57-42fa-85ab-55eed07f0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:01.984592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8462eb0e-bc57-42fa-85ab-55eed07f0850 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:01.985915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8462eb0e-bc57-42fa-85ab-55eed07f0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.051019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.077869 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 534/1074] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:49:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:02.122573 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.123114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.123114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.124485 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 541/1075] 10.222.0.13 () {54 vars in 943 bytes} [Sun Oct 16 00:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:49:02.131256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03cfe-94ac-4e26-86d7-6e2f03870e04 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.131538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03cfe-94ac-4e26-86d7-6e2f03870e04 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.131776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd03cfe-94ac-4e26-86d7-6e2f03870e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.209868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bbd03cfe-94ac-4e26-86d7-6e2f03870e04 None None] MFA Rules not processed for user `5fdb324c26934b11b3c4fe8dff574d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:02.211031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bbd03cfe-94ac-4e26-86d7-6e2f03870e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.319525 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 535/1076] 10.222.0.13 () {58 vars in 1040 bytes} [Sun Oct 16 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:02.328952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:02.330493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.354964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.469834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00532a29-0292-4865-84bc-7b14aa1b33ec None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:02.577079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:02.577686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.577948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.578229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.579909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.587816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.673870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:02.675483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce2e9a-4549-4a47-8287-5c2c6a5b3dc4 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:02.683803 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 542/1077] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 00:49:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:49:02.720372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.720645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.721025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.722548 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 536/1078] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:02.728382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f3c2c-afa0-4be9-80d2-e90ff0b44e6b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:02.728724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f3c2c-afa0-4be9-80d2-e90ff0b44e6b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:02.729181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f3c2c-afa0-4be9-80d2-e90ff0b44e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:02.816739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d62f3c2c-afa0-4be9-80d2-e90ff0b44e6b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:02.820386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d62f3c2c-afa0-4be9-80d2-e90ff0b44e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:02.927368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:02.929849 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 543/1079] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:03.215348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:03.216928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:03.261102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:03.374466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf39b4b-6c93-47b1-bc8d-65d46cf7d1e6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:03.502890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:03.504820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:03.505660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:03.505947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:03.506220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:03.508513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:03.608348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:03.610018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83c4cb-c833-4301-b42d-ef722e25ff7a service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:03.633131 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 537/1080] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:05.881891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:05.882517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:05.882517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:05.886765 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 544/1081] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:49:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:05.889207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b539ff-015e-4bc0-a6c3-145b249b9e11 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:05.889660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b539ff-015e-4bc0-a6c3-145b249b9e11 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:05.889753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b539ff-015e-4bc0-a6c3-145b249b9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:05.957431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-91b539ff-015e-4bc0-a6c3-145b249b9e11 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:05.958753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-91b539ff-015e-4bc0-a6c3-145b249b9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:06.034307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:06.071246 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 538/1082] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:06.349531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:06.351098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:06.512532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512157b-bc11-47a4-b41f-1dda2ac9c4ed None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:06.590279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:06.634875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:06.637267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:06.637267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:06.637267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:06.637651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:06.736585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:06.738225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bcc34f-89b1-415c-9146-869b8774f497 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:06.758573 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 545/1083] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:08.916875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:08.917428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:08.917428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:08.918714 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 539/1084] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:08.924159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0be47-39bd-410d-b8bd-0a81e13e530d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:08.925038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0be47-39bd-410d-b8bd-0a81e13e530d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:08.925311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0be47-39bd-410d-b8bd-0a81e13e530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:09.002189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e6a0be47-39bd-410d-b8bd-0a81e13e530d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:09.003513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e6a0be47-39bd-410d-b8bd-0a81e13e530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:09.044461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:09.120091 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 546/1085] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:09.411818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:09.413682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:09.572588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e46c1a-764f-4846-8f19-3699b0e98258 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:09.632394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:09.695557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:09.696107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:09.696369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:09.696630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:09.698249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:09.800166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:09.802057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6bcc6-e144-4a9b-87f4-668f7b0c2daa service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:09.834661 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 540/1086] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:19.118866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=27 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:19.831824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=73 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:24.829969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d18b7-8f3c-4786-ac50-d9aba746125b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:24.830589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d18b7-8f3c-4786-ac50-d9aba746125b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:24.830589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d18b7-8f3c-4786-ac50-d9aba746125b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:24.831898 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 547/1087] 10.222.0.13 () {54 vars in 918 bytes} [Sun Oct 16 00:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:24.837049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf34b8-6054-4c7d-a76a-057596eab7e9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:24.837521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf34b8-6054-4c7d-a76a-057596eab7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:24.837521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf34b8-6054-4c7d-a76a-057596eab7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:24.916381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-27cf34b8-6054-4c7d-a76a-057596eab7e9 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:24.917666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-27cf34b8-6054-4c7d-a76a-057596eab7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:25.031961 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 541/1088] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 16 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:25.049812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0252ce-1084-4b08-bc5a-7904d60f46a6 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:25.050094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0252ce-1084-4b08-bc5a-7904d60f46a6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:25.050362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0252ce-1084-4b08-bc5a-7904d60f46a6 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:25.051687 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 548/1089] 10.222.0.13 () {54 vars in 918 bytes} [Sun Oct 16 00:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:25.056643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86e5d-dc9c-4324-b0f4-1a8aa9a40f8b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:25.056952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86e5d-dc9c-4324-b0f4-1a8aa9a40f8b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:25.057226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a86e5d-dc9c-4324-b0f4-1a8aa9a40f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:25.134367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:25.137451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e8a86e5d-dc9c-4324-b0f4-1a8aa9a40f8b None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:25.139381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e8a86e5d-dc9c-4324-b0f4-1a8aa9a40f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:25.266775 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 542/1090] 10.222.0.13 () {58 vars in 1015 bytes} [Sun Oct 16 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:27.823940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:27.824544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:27.824544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:27.826601 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 549/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:27.835671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd511427-b150-485f-81a2-4ecbf898b340 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:27.836085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd511427-b150-485f-81a2-4ecbf898b340 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:27.836223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd511427-b150-485f-81a2-4ecbf898b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:27.907431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-fd511427-b150-485f-81a2-4ecbf898b340 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:27.908628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd511427-b150-485f-81a2-4ecbf898b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:27.963962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:28.005784 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 543/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:28.291322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:28.292957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:28.478129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd7e6b-646c-4568-a9ac-02d538489a46 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:28.565994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:28.609172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:28.609774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:28.610044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:28.610306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:28.611892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:28.728991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:28.730998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac794827-0d61-449f-898e-8309613ca652 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:28.751327 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 550/1093] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:29.909926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:29.910610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:29.910610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:29.911830 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 544/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:29.918438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f712a-c6d2-4e5e-9639-5d1d6d28dac8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:29.918877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f712a-c6d2-4e5e-9639-5d1d6d28dac8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:29.918980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f712a-c6d2-4e5e-9639-5d1d6d28dac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:30.001610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-287f712a-c6d2-4e5e-9639-5d1d6d28dac8 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:30.002827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-287f712a-c6d2-4e5e-9639-5d1d6d28dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:30.030191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:30.104036 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 551/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:30.256717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:30.258201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:30.407051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6891f-a179-40da-93b9-a764f8e1066c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:30.449166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:30.523428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:30.524037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:30.524310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:30.524574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:30.526208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:30.631313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:30.633011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74c339-49b7-4321-b4ff-f13de5ed9229 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:30.651151 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 545/1096] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:31.773489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:31.774092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:31.774092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:31.775381 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 552/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:31.782770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882f3a-6317-4038-ba7b-ee9a782e432d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:31.783544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882f3a-6317-4038-ba7b-ee9a782e432d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:31.783703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17882f3a-6317-4038-ba7b-ee9a782e432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:31.845085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:31.867753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-17882f3a-6317-4038-ba7b-ee9a782e432d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:31.869001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-17882f3a-6317-4038-ba7b-ee9a782e432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:31.966821 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 546/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:32.117816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:32.119374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:32.274973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0276d-b1aa-46a5-a40f-315284099336 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:32.289649 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:32.393340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:32.393896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:32.394170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:32.394439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:32.396052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:32.486684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:32.488291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c25898-f533-4f22-868d-3b64741016ac service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:32.506588 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 553/1099] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:33.590469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:33.591408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:33.591408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:33.593496 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 547/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:33.601444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36518b7-492c-4662-9b8d-ed439271525e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:33.602119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36518b7-492c-4662-9b8d-ed439271525e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:33.602235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36518b7-492c-4662-9b8d-ed439271525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:33.630320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:33.690145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a36518b7-492c-4662-9b8d-ed439271525e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:33.691372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a36518b7-492c-4662-9b8d-ed439271525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:33.794186 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 554/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:33.945109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:33.947320 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:34.063607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:34.101804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adfc2a-fd09-43c4-8ada-ebd29cc145bb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:34.220173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:34.220707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:34.221013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:34.221283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:34.222897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:34.308967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:34.323778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:34.325532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e820-5844-47e9-b9c5-0fae2d197133 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:34.343506 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 548/1102] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:35.448202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:35.448746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:35.448746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:35.450886 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 555/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:35.458062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499312e1-0f4d-4026-bd1a-8667ad1f3e17 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:35.458577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499312e1-0f4d-4026-bd1a-8667ad1f3e17 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:35.458577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499312e1-0f4d-4026-bd1a-8667ad1f3e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:35.536895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-499312e1-0f4d-4026-bd1a-8667ad1f3e17 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:35.538118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-499312e1-0f4d-4026-bd1a-8667ad1f3e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:35.640690 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 549/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:49:35.795504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:35.797999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:35.907252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:35.971718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f676-39be-4d34-bbc4-2d3aca4c8de3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:36.092116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:36.092723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:36.093105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:36.093368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:36.094988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:36.146896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:36.193412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:36.195008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8ab81-4946-4b1b-b7d6-87f9372cadbe service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:36.213933 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 556/1105] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:37.262878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:37.263542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:37.263542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:37.265502 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 550/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:37.275929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278acc-fa8a-43e4-a068-1438ab6dbda4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:37.276418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278acc-fa8a-43e4-a068-1438ab6dbda4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:37.276528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278acc-fa8a-43e4-a068-1438ab6dbda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:37.355748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c6278acc-fa8a-43e4-a068-1438ab6dbda4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:37.356979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c6278acc-fa8a-43e4-a068-1438ab6dbda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.459787 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 557/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:37.615789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:37.618358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.678057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:37.778711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c8fc5-3431-4d85-9952-50131b9d401b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:37.907880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:37.908408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:37.908683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:37.908992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:37.910617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:37.917758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:38.007661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:38.009295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e52fd-8743-43cf-b3ca-89be94bbfc09 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:38.027404 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 551/1108] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:39.074163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:39.075069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:39.075069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:39.077217 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 558/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:39.087102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e21bf-daed-4e0b-b356-34181df27b9b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:39.087102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e21bf-daed-4e0b-b356-34181df27b9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:39.087572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e21bf-daed-4e0b-b356-34181df27b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:39.169269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-354e21bf-daed-4e0b-b356-34181df27b9b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:39.170465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-354e21bf-daed-4e0b-b356-34181df27b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:39.249873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:39.285396 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 552/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:39.440052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:39.442362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:39.464057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:39.610388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322bd80-4b39-4a71-9006-1c56b8c79d79 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:39.699398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:39.727212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:39.727825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:39.728094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:39.728360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:39.729993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:39.822858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:39.824456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125663f-1526-4b90-9eb0-6dd9251e29d9 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:39.844917 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 559/1111] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:40.904637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:40.905562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:40.905562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:40.907838 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 553/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:40.915142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82ccc-1efd-4487-a705-3989c6bd8e69 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:40.915940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82ccc-1efd-4487-a705-3989c6bd8e69 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:40.916098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82ccc-1efd-4487-a705-3989c6bd8e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:41.000303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f0a82ccc-1efd-4487-a705-3989c6bd8e69 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:41.001537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0a82ccc-1efd-4487-a705-3989c6bd8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:41.045784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:41.109951 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 560/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:41.269433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:41.272261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:41.437598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6190c-9f7b-4cb8-807d-8f28ce7fca44 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:41.494886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:41.561620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:41.562144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:41.562416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:41.562682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:41.564289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:41.661768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:41.663355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3e088-fc6a-44f4-87f0-e0e61f69e234 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:41.682102 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 554/1114] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:42.738934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:42.739463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:42.739463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:42.740830 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 561/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:42.748155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082637-596c-42c1-9da9-0b0e19dd5756 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:42.748865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082637-596c-42c1-9da9-0b0e19dd5756 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:42.749027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b082637-596c-42c1-9da9-0b0e19dd5756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:42.832412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3b082637-596c-42c1-9da9-0b0e19dd5756 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:42.833647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3b082637-596c-42c1-9da9-0b0e19dd5756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:42.835719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:42.935891 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 555/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:43.083926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:43.085553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:43.240928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276f4f9-d630-4e21-a034-fe0160a2c2d8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:43.270015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:43.375137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:43.375748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:43.376024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:43.376291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:43.377925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:43.467862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:43.469541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4671-0d13-4866-ac9c-dfaeb03ae2f8 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:43.489454 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 562/1117] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:45.523919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:45.524493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:45.524493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:45.525862 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 556/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:45.532041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adb7-6f1d-448e-9763-e8b3c3135b43 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:45.532481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adb7-6f1d-448e-9763-e8b3c3135b43 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:45.532574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731adb7-6f1d-448e-9763-e8b3c3135b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:45.576313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:45.606861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7731adb7-6f1d-448e-9763-e8b3c3135b43 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:45.608351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7731adb7-6f1d-448e-9763-e8b3c3135b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:45.707413 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 563/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:45.987610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:45.990091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:46.107461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91feba3-fd81-4426-8553-0a3dd02116bf None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:46.140458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:46.184449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:46.185063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:46.185333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:46.185598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:46.187195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:46.300851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:46.302345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ff062-206a-4f95-9c4e-0c6f85985b97 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:46.321667 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 557/1120] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:48.565195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:48.565761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:48.565761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:48.567092 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 564/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:48.573724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba891-85c2-4e92-aeae-3cca2f7d1ec7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:48.574444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba891-85c2-4e92-aeae-3cca2f7d1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:48.574608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ba891-85c2-4e92-aeae-3cca2f7d1ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:48.649561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-596ba891-85c2-4e92-aeae-3cca2f7d1ec7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:48.650770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-596ba891-85c2-4e92-aeae-3cca2f7d1ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:48.663796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:48.750551 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 558/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:49.031738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:49.034240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:49.148133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ed6e0-995a-4b39-b1db-fc0fedbbb64f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:49.160137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:49.226151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:49.226762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:49.227038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:49.227332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:49.228942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:49.345753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:49.347764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7c78a-28fd-449c-8163-d208b7a1d6d5 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:49.372041 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 565/1123] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:49:51.794295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:51.794935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:51.794935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:51.796274 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 559/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:51.802112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dc5e-2c8a-4123-ab6e-c126a6fc425a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:51.802529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dc5e-2c8a-4123-ab6e-c126a6fc425a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:51.802620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dc5e-2c8a-4123-ab6e-c126a6fc425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:51.852125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:51.871371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5a29dc5e-2c8a-4123-ab6e-c126a6fc425a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:51.872575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5a29dc5e-2c8a-4123-ab6e-c126a6fc425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:51.969899 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 566/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:49:52.252312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:52.253936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:52.368420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7bbd8-9c59-45b9-ae9e-7d5bba2bc8c2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:52.408662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:52.450784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:52.451389 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:52.451662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:52.451924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:52.453537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:52.579401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:52.580870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfceb5e-2aca-48c6-886d-6058ba7f6ffd service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:52.599132 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 560/1126] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:54.852635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:54.853275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:54.853275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:54.854558 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 567/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:54.861099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d28-3638-4349-816e-7db427ff20e6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:54.861559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d28-3638-4349-816e-7db427ff20e6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:54.861665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f6d28-3638-4349-816e-7db427ff20e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:54.948150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e77f6d28-3638-4349-816e-7db427ff20e6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:54.949883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e77f6d28-3638-4349-816e-7db427ff20e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:54.972484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:55.051428 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 561/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:55.333098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:55.334649 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:55.449954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224e969-923d-4642-b15d-5e11bcc9fc90 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:55.472245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:55.529796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:55.530402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:55.530692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:55.530980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:55.532592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:55.653727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:55.655184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520d032-ff09-482c-8a16-2fed99bb4fde service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:55.674283 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 568/1129] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:49:57.830480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:57.831379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:57.831379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:57.833519 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 562/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:49:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:49:57.842561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73643-7f1a-4402-9cac-e4f00d483832 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:57.843007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73643-7f1a-4402-9cac-e4f00d483832 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:57.843132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73643-7f1a-4402-9cac-e4f00d483832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:57.915688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:57.918574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-61a73643-7f1a-4402-9cac-e4f00d483832 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:49:57.920447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-61a73643-7f1a-4402-9cac-e4f00d483832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:58.023765 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 569/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:49:58.308064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:49:58.310629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:58.419088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e010b14-afd4-4e9b-9a1c-0ee8ee554f6c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:49:58.471896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:49:58.506665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:49:58.507262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:49:58.507532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:49:58.507798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:49:58.509414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:49:58.621952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:49:58.623395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439889f6-d3d4-442d-a3b6-a70965d2657b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:49:58.645238 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 563/1132] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:00.829945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:00.830541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:00.830541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:00.831838 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 570/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:00.838278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cc84-e884-4909-99bd-b5c0d899a42a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:00.839016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cc84-e884-4909-99bd-b5c0d899a42a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:00.839182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932cc84-e884-4909-99bd-b5c0d899a42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:00.914968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1932cc84-e884-4909-99bd-b5c0d899a42a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:00.916181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1932cc84-e884-4909-99bd-b5c0d899a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:00.946855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:01.017119 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 564/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:01.300640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:01.303205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:01.433362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3220f-3388-457f-999f-70cc59ffd28e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:01.475489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:01.525403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:01.526007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:01.526278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:01.526552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:01.528145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:01.642483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:01.643850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95bd31-423e-4b78-a409-dcf944bdc76a service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:01.662814 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 571/1135] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:03.825565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:03.826429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:03.826429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:03.828450 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 565/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:50:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:03.834001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc4be-ee60-4c24-bd4c-7170701f2729 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:03.834453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc4be-ee60-4c24-bd4c-7170701f2729 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:03.834547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91acc4be-ee60-4c24-bd4c-7170701f2729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:03.903129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-91acc4be-ee60-4c24-bd4c-7170701f2729 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:03.904322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-91acc4be-ee60-4c24-bd4c-7170701f2729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:03.912655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:04.004976 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 572/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:04.286306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:04.287894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:04.399528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282425f6-cad9-4a80-90df-4dfe76b3ee1c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:04.455733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:04.474528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:04.475120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:04.475394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:04.475649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:04.477642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:04.591254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:04.592689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f81631-eff5-44e1-adaa-9cbfa0d9f9d0 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:04.612620 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 566/1138] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:06.782057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:06.782679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:06.782679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:06.783979 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:06.789661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd2fd-a7b2-4eb1-be3c-4baf89aee6a9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:06.790108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd2fd-a7b2-4eb1-be3c-4baf89aee6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:06.790220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd2fd-a7b2-4eb1-be3c-4baf89aee6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:06.861422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-55afd2fd-a7b2-4eb1-be3c-4baf89aee6a9 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:06.862644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55afd2fd-a7b2-4eb1-be3c-4baf89aee6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:06.903264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:06.968141 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:07.247311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:07.248864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:07.362610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eed331-c4aa-4fee-8a58-a0aee096f863 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:07.400388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:07.444781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:07.445421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:07.445686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:07.445949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:07.447541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:07.559669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:07.561162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744615f-001a-4ad8-9cd3-993b4584f5a2 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:07.585604 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 574/1141] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:50:09.707323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.708239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.708239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.710308 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:09.716914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec373c-a909-4012-ae5a-e2b8a4cb5382 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:09.717420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec373c-a909-4012-ae5a-e2b8a4cb5382 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:09.717540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec373c-a909-4012-ae5a-e2b8a4cb5382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:09.794345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a1ec373c-a909-4012-ae5a-e2b8a4cb5382 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:09.795570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1ec373c-a909-4012-ae5a-e2b8a4cb5382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:09.814977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:09.897584 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:10.176982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:10.178582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:10.289860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33118f1-e0fa-4221-ae33-cb2204c84a59 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:10.364169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:10.371250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:10.371862 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:10.372135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:10.372403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:10.374082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:10.495225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:10.497473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2460e7-71d2-4797-8dba-2a9699162459 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:10.517437 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 569/1144] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:12.658800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.659746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.659746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.661898 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:50:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:12.667576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8a7-723f-4874-ae24-9023035ffbbe None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:12.668060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8a7-723f-4874-ae24-9023035ffbbe None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:12.668060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9f8a7-723f-4874-ae24-9023035ffbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:12.736671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a5b9f8a7-723f-4874-ae24-9023035ffbbe None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:12.737911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a5b9f8a7-723f-4874-ae24-9023035ffbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:12.786240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:12.841450 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:13.124046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:13.125680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.232566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e13fd9-1088-4c20-ab85-ff0f874fb0ad None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:13.284329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:13.313429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:13.314065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:13.314339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:13.314608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:13.316256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:13.429175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:13.430529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a59644-632d-4b0c-b9ff-54e14a43b5e1 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:13.456429 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 577/1147] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:22.838749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=22 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:23.454116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=66 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:33.158249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c129a65-828b-4ef1-89c9-8d6306a1ab9b None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.158819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c129a65-828b-4ef1-89c9-8d6306a1ab9b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.158819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c129a65-828b-4ef1-89c9-8d6306a1ab9b None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.160900 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 571/1148] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:33.167295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89165-bd93-4a26-bb43-969e249b0163 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.167745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89165-bd93-4a26-bb43-969e249b0163 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.167839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89165-bd93-4a26-bb43-969e249b0163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.240285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-79a89165-bd93-4a26-bb43-969e249b0163 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:33.241521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79a89165-bd93-4a26-bb43-969e249b0163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:33.340433 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 578/1149] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:33.641740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.642015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.642285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.643618 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 572/1150] 10.222.0.13 () {54 vars in 962 bytes} [Sun Oct 16 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:33.649772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a546b6-4af3-4878-a33e-8cace5703da2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:33.650097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a546b6-4af3-4878-a33e-8cace5703da2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:33.650472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a546b6-4af3-4878-a33e-8cace5703da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:33.731753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-02a546b6-4af3-4878-a33e-8cace5703da2 None None] MFA Rules not processed for user `1f1ad7b6fd7e432c9b56d2a5bad33854`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:33.732988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-02a546b6-4af3-4878-a33e-8cace5703da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:33.754452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:33.814257 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 579/1151] 10.222.0.13 () {58 vars in 1059 bytes} [Sun Oct 16 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:33.822430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:33.823963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:33.934891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d6d6b-ec91-4515-8e82-9e2593927f8a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:34.017794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:34.018393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:34.018671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:34.018921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:34.020492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:34.077734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:34.137450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:34.138945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce24bbb-1586-4e75-9826-988536c98166 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:34.158508 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 573/1152] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:36.345641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:36.346224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:36.346224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:36.347438 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 580/1153] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:36.353358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee24d-2434-4988-8b52-56fbc400eb73 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:36.353822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee24d-2434-4988-8b52-56fbc400eb73 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:36.353929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ee24d-2434-4988-8b52-56fbc400eb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:36.426547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a88ee24d-2434-4988-8b52-56fbc400eb73 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:36.427774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a88ee24d-2434-4988-8b52-56fbc400eb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:36.525974 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 574/1154] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:36.792687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:36.795219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:36.939490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5b31-28bd-4ddf-8438-7cff776825e2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:36.992259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:37.036182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:37.036788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:37.037088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:37.037353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:37.037982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:37.039090 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:50:37.039090 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:50:37.039090 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:50:37.040225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f863a1-2f6f-4dab-99ce-860032bdb135 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:37.059264 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 581/1155] 10.222.0.13 () {56 vars in 1108 bytes} [Sun Oct 16 00:50:36 2022] GET /identity/v3/projects => generated 2553 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:50:39.217600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:39.218543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:39.218543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:39.220572 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 575/1156] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:39.229824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab260-ffb3-4e49-9d7c-64ade7410923 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:39.230276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab260-ffb3-4e49-9d7c-64ade7410923 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:39.230385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eab260-ffb3-4e49-9d7c-64ade7410923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:39.300164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d2eab260-ffb3-4e49-9d7c-64ade7410923 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:39.301393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d2eab260-ffb3-4e49-9d7c-64ade7410923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:39.402145 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 582/1157] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:39.694355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:39.695888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:39.705904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:39.844153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e14cf-5b1c-4459-8fa0-9078c60a831d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:39.936401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:39.970249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:39.970860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:39.971231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:39.971538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:39.973177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:40.077904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:40.079690 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b30c4-7ac5-4b8f-b886-f644631a3c63 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:40.098601 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 576/1158] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:42.408599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:42.409209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:42.409209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:42.410452 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 583/1159] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:42.416993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bbde-8684-4493-9f91-ad830c453764 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:42.417436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bbde-8684-4493-9f91-ad830c453764 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:42.417553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0bbde-8684-4493-9f91-ad830c453764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:42.494572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-05a0bbde-8684-4493-9f91-ad830c453764 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:42.495803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05a0bbde-8684-4493-9f91-ad830c453764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:42.542615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:42.593879 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 577/1160] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:42.879507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:42.882069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:42.911018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:42.997442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a575426-58b4-4904-a420-a3a81cad5660 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:43.083299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:43.083911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:43.084152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:43.084525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:43.086092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:43.161429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:43.197080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:43.198525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22363-6e05-4491-8a6c-77e923072b49 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:43.217613 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 584/1161] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:45.380004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:45.380885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:45.380885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:45.383044 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 578/1162] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:45.391641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f2bb-5cb4-44cf-9289-c88bad815aab None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:45.392066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f2bb-5cb4-44cf-9289-c88bad815aab None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:45.392171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f2bb-5cb4-44cf-9289-c88bad815aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:45.460464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9837f2bb-5cb4-44cf-9289-c88bad815aab None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:45.461755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9837f2bb-5cb4-44cf-9289-c88bad815aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:45.563052 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 585/1163] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:45.859809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:45.861405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:45.991962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8ea5-4f68-4314-82fa-8c04e84aedb7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:46.068149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:46.069604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:46.070224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:46.070567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:46.070898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:46.073651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:46.188674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:46.190111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d78dd-9f34-4266-b387-cf7de99ad39c service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:46.210090 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 579/1164] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:48.410425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:48.410980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:48.410980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:48.412978 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 586/1165] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:48.422176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5893e2-5170-49bb-a3e1-00fb581c515c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:48.422567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5893e2-5170-49bb-a3e1-00fb581c515c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:48.422775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5893e2-5170-49bb-a3e1-00fb581c515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:48.492511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4c5893e2-5170-49bb-a3e1-00fb581c515c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:48.493755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4c5893e2-5170-49bb-a3e1-00fb581c515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:48.548245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:48.593286 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 580/1166] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:48.881232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:48.883984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:48.923721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:48.994443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36cca-d5d4-4466-bcff-df15998ed42b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:49.083350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:49.083965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:49.084240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:49.084506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:49.086145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:49.171791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:49.202075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:49.203731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a3de0-624b-4c13-b9c7-260b39bbbf36 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:49.222043 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 587/1167] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:50:51.628514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:51.629496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:51.629496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:51.631729 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 581/1168] 10.222.0.13 () {54 vars in 927 bytes} [Sun Oct 16 00:50:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:50:51.638084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2133-4038-4404-96c2-7c8c4b3cca55 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:51.638867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2133-4038-4404-96c2-7c8c4b3cca55 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:51.639034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad2133-4038-4404-96c2-7c8c4b3cca55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:51.714993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-41ad2133-4038-4404-96c2-7c8c4b3cca55 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:50:51.716199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-41ad2133-4038-4404-96c2-7c8c4b3cca55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:51.826665 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 588/1169] 10.222.0.13 () {58 vars in 1024 bytes} [Sun Oct 16 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:50:52.116339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:50:52.117948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:52.234683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c10b-05d6-417c-92a9-3837919817bd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:50:52.309251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:50:52.309851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:50:52.310121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:50:52.310388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:50:52.311955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:50:52.321032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:50:52.423198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:50:52.424658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387dab5-6609-49c0-874c-b8c09bd935cf service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:50:52.444614 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 582/1170] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:51:01.825173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=82 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:51:02.440709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=50 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:10.304406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:10.305386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:10.305386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:10.394258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:10.395476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:10.501629 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 589/1171] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:10.509873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:10.510402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:10.510402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:10.586942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:10.588057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:10.688226 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 583/1172] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:10.693291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:10.694470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:10.706330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05536e8e-4d80-487b-9bee-118775e2ba63 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:10.774084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:10.809548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:10.810153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:10.810434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:10.810699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:10.811339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:52:10.811637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:10.812655 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:10.812655 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:52:10.812655 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:52:10.813574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:10.825095 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 590/1173] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:52:10.840510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:10.852193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730683-2723-4a66-a426-764f360ef1fc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:10.915184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:10.953526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:10.954137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:10.954391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:10.954684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:10.955310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:10.956412 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:10.956412 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:52:10.956412 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:52:10.957650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:11.015172 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 584/1174] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:52:10 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:52:11.021013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.022536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.056495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b12c4e-3b04-4563-9424-68b709e839fc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:11.153579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:11.154104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.154379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.154614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.155274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:11.156289 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:11.156289 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:52:11.156289 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:52:11.157527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:11.201381 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 591/1175] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:52:11.205721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.207658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.270885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748daa3-b450-49df-a776-3a390ea2d71c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:11.359083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.370200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:11.370792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.371099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.371362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.372008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:11.374045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:11.388481 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 585/1176] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:52:11.392606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.394226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.405861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671a30-3e32-42af-b826-4ed871cd6c81 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:11.431214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.503806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:11.504409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.504681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.504980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.505617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:11.507215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a86e1-6932-496b-b7f6-c9bf00b2fb6f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:11.519624 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 592/1177] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:52:11.523939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:11.525509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.560237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93272b5d-058a-49ba-8e49-97dcba2216d7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:11.670600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:11.671178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.671449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.671711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] PATH_INFO: `/v3/projects/a47ad18bcded4420bd20a2f666d32384/users/0026b86ef4bc4aa49c3af32d3ac061a4/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.694636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47ad18bcded4420bd20a2f666d32384, user_id=0026b86ef4bc4aa49c3af32d3ac061a4, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:11.697309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03f97c-7107-46a8-bc6e-571dbd34cd0f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:11.725758 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 586/1178] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:52:11 2022] PUT /identity/v3/projects/a47ad18bcded4420bd20a2f666d32384/users/0026b86ef4bc4aa49c3af32d3ac061a4/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:52:11.737833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e76d3-b3a4-475a-ada9-0402bf18f5ab None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.738118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e76d3-b3a4-475a-ada9-0402bf18f5ab None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.738388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e76d3-b3a4-475a-ada9-0402bf18f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.795175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d06e76d3-b3a4-475a-ada9-0402bf18f5ab None None] MFA Rules not processed for user `0026b86ef4bc4aa49c3af32d3ac061a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:11.796392 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d06e76d3-b3a4-475a-ada9-0402bf18f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:11.876395 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 593/1179] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:11.890275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.890560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.890831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.892195 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 587/1180] 10.222.0.13 () {54 vars in 963 bytes} [Sun Oct 16 00:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:11.897329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b5f3-8dba-4217-b8ef-29049a8f9e00 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:11.897616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b5f3-8dba-4217-b8ef-29049a8f9e00 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:11.897885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42b5f3-8dba-4217-b8ef-29049a8f9e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:11.932365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:11.977717 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3c42b5f3-8dba-4217-b8ef-29049a8f9e00 None None] MFA Rules not processed for user `f1f42430209d4ae9b1c0d039e1797a40`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:11.979284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c42b5f3-8dba-4217-b8ef-29049a8f9e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.067885 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 594/1181] 10.222.0.13 () {58 vars in 1060 bytes} [Sun Oct 16 00:52:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:12.076007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:12.077593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.140739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.199598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2fe4b-b30e-49cc-8964-3e3bd19f76ac None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:12.280691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:12.281323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.281598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.281861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.283442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.384512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:12.385981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:12.389392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.404420 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 588/1182] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:12.450528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461ee4-4fff-465d-b73d-382c20fe8525 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.450976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461ee4-4fff-465d-b73d-382c20fe8525 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.450976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461ee4-4fff-465d-b73d-382c20fe8525 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.452265 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 595/1183] 10.222.0.13 () {52 vars in 830 bytes} [Sun Oct 16 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:52:12.456163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:12.457526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.560467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ab145-5331-42f7-a386-f199b8f01b47 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:12.655460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:12.656081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.656350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.656612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] PATH_INFO: `/v3/users/0026b86ef4bc4aa49c3af32d3ac061a4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.669553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0026b86ef4bc4aa49c3af32d3ac061a4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:12.670580 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:12.670580 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:52:12.670580 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:52:12.671793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:12.681658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.740886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0026b86ef4bc4aa49c3af32d3ac061a4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:12.741370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0026b86ef4bc4aa49c3af32d3ac061a4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:12.752685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0026b86ef4bc4aa49c3af32d3ac061a4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:12.776433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0026b86ef4bc4aa49c3af32d3ac061a4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:12.790057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0026b86ef4bc4aa49c3af32d3ac061a4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:12.795985 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 589/1184] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:52:12 2022] DELETE /identity/v3/users/0026b86ef4bc4aa49c3af32d3ac061a4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:52:12.800673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:12.800989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:12.801260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:12.860969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:52:12.862191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:12.945605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:12.958188 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 596/1185] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:52:12.968313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:12.969596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.078937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32cabe-7190-4085-b098-da3d66ff134a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:13.139031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:13.160672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:13.161313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:13.161582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:13.161856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:13.163454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.280018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:13.281500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6595-4d8f-4851-ac75-9b8139e959f1 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:13.300175 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 590/1186] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:52:13.635952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:52:13.637267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:52:13.649156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3a0e-a319-418c-8e4f-eebb96815c23 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:52:13.758720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:52:13.759376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:52:13.759653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:52:13.759916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] PATH_INFO: `/v3/projects/a47ad18bcded4420bd20a2f666d32384` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:52:13.770802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47ad18bcded4420bd20a2f666d32384)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:52:13.771840 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:52:13.771840 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:52:13.771840 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:52:13.773150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:52:13.837108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47ad18bcded4420bd20a2f666d32384', 'request_id': 'req-5dfbed41-6338-4f87-8d78-ec4707cd30c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:13.845169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47ad18bcded4420bd20a2f666d32384', 'request_id': 'req-5dfbed41-6338-4f87-8d78-ec4707cd30c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:13.858975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47ad18bcded4420bd20a2f666d32384', 'request_id': 'req-5dfbed41-6338-4f87-8d78-ec4707cd30c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:13.886846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] The token cache is being invalidate because project a47ad18bcded4420bd20a2f666d32384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:52:13.887133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:13.887642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5dfbed41-6338-4f87-8d78-ec4707cd30c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:52:13.888973 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 597/1187] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:52:13 2022] DELETE /identity/v3/projects/a47ad18bcded4420bd20a2f666d32384 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:52:23.297654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=62 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:52:23.885180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:54.010835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:54.011777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:54.011777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:54.013842 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 591/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:54.021796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f31c6f-046f-4287-aaf9-cf8b3cfe2493 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:54.022547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f31c6f-046f-4287-aaf9-cf8b3cfe2493 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:54.022714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f31c6f-046f-4287-aaf9-cf8b3cfe2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:54.112992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-84f31c6f-046f-4287-aaf9-cf8b3cfe2493 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:54.114189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-84f31c6f-046f-4287-aaf9-cf8b3cfe2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:54.228447 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 598/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:54.385846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:54.389699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:54.514577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c2f0c-f950-48b3-8a88-d5dbab8d8459 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:54.520539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:54.521161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:54.521429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:54.521691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:54.529832 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:54.531418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d54482-abc7-4da7-af88-73606a93a988 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:54.540860 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 592/1190] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:53:54.984118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ab3c-5576-44d1-aaab-d18cfe941476 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:54.984376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ab3c-5576-44d1-aaab-d18cfe941476 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:54.984652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ab3c-5576-44d1-aaab-d18cfe941476 None None] PATH_INFO: `/v3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:54.985988 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 599/1191] 10.222.0.43 () {54 vars in 925 bytes} [Sun Oct 16 00:53:54 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:53:54.993010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919205dd-1027-422a-a720-fd5a412dc7df None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:54.993287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919205dd-1027-422a-a720-fd5a412dc7df None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:54.993559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919205dd-1027-422a-a720-fd5a412dc7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:55.057005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-919205dd-1027-422a-a720-fd5a412dc7df None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:55.058235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-919205dd-1027-422a-a720-fd5a412dc7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:55.132296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:53:55.137773 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 593/1192] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 16 00:53:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:55.614673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a69-dfb5-4f24-af3f-ebb871efc8ea None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:55.615241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a69-dfb5-4f24-af3f-ebb871efc8ea None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:55.615241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94a69-dfb5-4f24-af3f-ebb871efc8ea None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:55.616531 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 600/1193] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:53:55.625481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47a28-883b-4b2c-a8cc-0669fb25a84c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:55.626231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47a28-883b-4b2c-a8cc-0669fb25a84c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:55.626723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47a28-883b-4b2c-a8cc-0669fb25a84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:55.649383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-57c47a28-883b-4b2c-a8cc-0669fb25a84c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:53:55.650591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-57c47a28-883b-4b2c-a8cc-0669fb25a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:53:55.659308 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 594/1194] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:53:55.810755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94a69-dfb5-4f24-af3f-ebb871efc8ea None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:53:55.825874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94a69-dfb5-4f24-af3f-ebb871efc8ea None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:53:55.831598 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:53:55.832198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:53:55.832472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:53:55.832741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:53:55.841234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:53:55.842850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774f3dd-ee55-4c74-b977-31b99aeb2a77 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:53:55.852480 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 601/1195] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:03.857761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0755e8-b517-4378-b817-faccc32d4124 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:03.858331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0755e8-b517-4378-b817-faccc32d4124 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:03.858331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0755e8-b517-4378-b817-faccc32d4124 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:03.859697 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 595/1196] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:03.864977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c24c71-b51a-4033-8580-2b8a8e665698 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:03.865432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c24c71-b51a-4033-8580-2b8a8e665698 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:03.865534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c24c71-b51a-4033-8580-2b8a8e665698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:03.888677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c7c24c71-b51a-4033-8580-2b8a8e665698 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:03.889955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c7c24c71-b51a-4033-8580-2b8a8e665698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:03.899663 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 602/1197] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:54:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:03.907431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0755e8-b517-4378-b817-faccc32d4124 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:03.922077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0755e8-b517-4378-b817-faccc32d4124 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:03.927322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:03.927904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:03.928174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:03.928436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:03.936634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:03.938292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08c7c7-6fea-49c5-8209-489ee86a6bd1 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:03.947595 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 596/1198] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:07.289465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef519a4-6130-4d5c-bfbc-8040705575e0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:07.290379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef519a4-6130-4d5c-bfbc-8040705575e0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:07.290379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef519a4-6130-4d5c-bfbc-8040705575e0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:07.292470 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 603/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:54:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:07.299639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644f08-8b78-4fc9-8759-9c79107c6cf2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:07.300093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644f08-8b78-4fc9-8759-9c79107c6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:07.300199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644f08-8b78-4fc9-8759-9c79107c6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:07.324722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7a644f08-8b78-4fc9-8759-9c79107c6cf2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:07.325981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7a644f08-8b78-4fc9-8759-9c79107c6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:07.336478 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 597/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:07.492883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef519a4-6130-4d5c-bfbc-8040705575e0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:07.512028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef519a4-6130-4d5c-bfbc-8040705575e0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:07.517878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:07.518472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:07.518751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:07.519017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:07.527196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:07.528764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578ad0-41c9-4c13-9d44-79338c7e0577 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:07.538151 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 604/1201] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:08.590376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfb9a-0d63-4958-b4c6-bc589f8b8544 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:08.591053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfb9a-0d63-4958-b4c6-bc589f8b8544 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:08.591053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfb9a-0d63-4958-b4c6-bc589f8b8544 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:08.593099 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 598/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 16 00:54:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:08.600296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd408-268b-4ec9-99b9-68060cc67142 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:08.601163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd408-268b-4ec9-99b9-68060cc67142 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:08.601163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd408-268b-4ec9-99b9-68060cc67142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:08.629719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-eadbd408-268b-4ec9-99b9-68060cc67142 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:08.630906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eadbd408-268b-4ec9-99b9-68060cc67142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:08.640202 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 605/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 16 00:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:08.793088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfb9a-0d63-4958-b4c6-bc589f8b8544 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:08.815829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfb9a-0d63-4958-b4c6-bc589f8b8544 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:08.822481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:08.823078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:08.823358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:08.823631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:08.832208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:08.833740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7ea77-ebf4-4c75-b940-bb376b1a5466 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:08.843635 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 599/1204] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:12.886365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:12.887009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:12.887009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:12.888360 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 606/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:12.894876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623d5-5956-4c26-9339-55858e215671 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:12.895345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623d5-5956-4c26-9339-55858e215671 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:12.895462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128623d5-5956-4c26-9339-55858e215671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:12.923783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-128623d5-5956-4c26-9339-55858e215671 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:12.925005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-128623d5-5956-4c26-9339-55858e215671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:12.934123 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 600/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:13.228943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:13.231493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:13.266933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:13.313134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59300425-b457-4f81-bf97-5cf88350dd0f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:13.317387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:13.317994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:13.318265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:13.318531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:13.327641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:13.329104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ca8ca-9df0-4ec8-b216-7e4a0bb09901 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:13.339553 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 607/1207] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:15.463692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676085d-34f4-460a-b92e-1375b641a5a3 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:15.464272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676085d-34f4-460a-b92e-1375b641a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:15.464272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676085d-34f4-460a-b92e-1375b641a5a3 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:15.465683 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 601/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:15.471116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b90-671f-4de6-98f2-9bb1f8fdafb3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:15.471595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b90-671f-4de6-98f2-9bb1f8fdafb3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:15.471595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2b90-671f-4de6-98f2-9bb1f8fdafb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:15.493788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ca6a2b90-671f-4de6-98f2-9bb1f8fdafb3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:15.494982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ca6a2b90-671f-4de6-98f2-9bb1f8fdafb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:15.503350 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 608/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:15.788178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676085d-34f4-460a-b92e-1375b641a5a3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:15.802369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676085d-34f4-460a-b92e-1375b641a5a3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:15.806718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:15.807312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:15.807587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:15.807855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:15.816815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:15.818275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec0bd-5a13-4f00-8db5-dea82b0e58b3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:15.827875 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 602/1210] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:19.395130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:19.395708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:19.395708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:19.397742 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 609/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:19.404538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf00e-ed2c-450e-8749-7d18b8d858ac None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:19.405370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf00e-ed2c-450e-8749-7d18b8d858ac None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:19.405542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acf00e-ed2c-450e-8749-7d18b8d858ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:19.431858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c4acf00e-ed2c-450e-8749-7d18b8d858ac None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:19.433089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c4acf00e-ed2c-450e-8749-7d18b8d858ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:19.442330 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 603/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:19.746524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:19.748474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:19.832882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af90bd-ae9f-4919-99a0-2d9b382f9761 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:19.836873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:19.837501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:19.837772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:19.838041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:19.847248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:19.848684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319ad78-9e32-436f-8f02-6e1bae7c9221 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:19.858594 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 610/1213] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:21.991950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:21.992991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:21.992991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:21.995278 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 604/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 16 00:54:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:54:22.000723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35641982-ae9f-4165-8589-501af448a25f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:22.001215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35641982-ae9f-4165-8589-501af448a25f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:22.001318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35641982-ae9f-4165-8589-501af448a25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:22.021916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-35641982-ae9f-4165-8589-501af448a25f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:54:22.023114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-35641982-ae9f-4165-8589-501af448a25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:22.032555 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 611/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 16 00:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:54:22.331563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:54:22.335117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:54:22.350092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79269a64-9d7b-4280-aaab-ddfd99093438 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:54:22.354788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:54:22.355433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:54:22.355684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:54:22.355950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:54:22.364966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:54:22.366396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4882ba1-9797-45c1-a56b-bab5fed2b5b3 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:54:22.375814 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 605/1216] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:54:32.017445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=63 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:54:32.371932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=37 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:58.605602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.619004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.619004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.632759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:58.634131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:58.646762 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 612/1217] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:58.658893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.659530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.659530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.690783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:58.692013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:58.707574 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 606/1218] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:58.713322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:58.726041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cf530-a2f8-4e9e-a311-a0bccf1b0cf0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:58.734773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:58.735410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.735686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.735957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.736623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:58.736951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:58.738621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:58.762996 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 613/1219] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:58.771092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:58.784398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0dad6-0d9f-49c7-8e41-29f3ce0c2389 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:58.791386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:58.791997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.792270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.792538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.793192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:58.795127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157576a-0685-4508-8d42-42274c0f4ad1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:58.864667 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 607/1220] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:58 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:58.868691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:58.883922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7867c-8fb5-4ad9-a041-614d13be662d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:58.938562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5625-f5b1-4f74-8803-2725c24e65f7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.938911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5625-f5b1-4f74-8803-2725c24e65f7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.939106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec5625-f5b1-4f74-8803-2725c24e65f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.962051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7fec5625-f5b1-4f74-8803-2725c24e65f7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:58.964005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7fec5625-f5b1-4f74-8803-2725c24e65f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:58.976075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:58.977096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:58.977910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:58.978403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:58.979242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:58.981657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f2f95-5f76-40d0-8f5a-cdad976bfb14 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.030964 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 614/1221] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:55:58 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.035044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.035341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.035621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.067313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.068539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.072876 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 608/1222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:55:59.074146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1011-78dd-4a24-a025-4af9c123e9dc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.075794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1011-78dd-4a24-a025-4af9c123e9dc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.075794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba1011-78dd-4a24-a025-4af9c123e9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.095246 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 615/1223] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.095246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.101791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08d300-9e73-4dab-b07c-e54f4327bfdd None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.104385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-deba1011-78dd-4a24-a025-4af9c123e9dc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.105637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-deba1011-78dd-4a24-a025-4af9c123e9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.106723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.107327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.107605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.107873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.108510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.110194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc29747-6df3-4cec-9a1c-10e36a8bcd29 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.113893 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 609/1224] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.114997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f20da-dd60-469e-a2c1-36182db5ff44 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.115218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f20da-dd60-469e-a2c1-36182db5ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.115893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f20da-dd60-469e-a2c1-36182db5ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.123532 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 616/1225] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:55:59.123532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d698-90fc-453f-ac49-f2cd42fc4c99 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.123532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d698-90fc-453f-ac49-f2cd42fc4c99 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.123532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86d698-90fc-453f-ac49-f2cd42fc4c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.137751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7c2f20da-dd60-469e-a2c1-36182db5ff44 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.138955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7c2f20da-dd60-469e-a2c1-36182db5ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.141343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9b86d698-90fc-453f-ac49-f2cd42fc4c99 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.142552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9b86d698-90fc-453f-ac49-f2cd42fc4c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.147245 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 610/1226] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.148232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7953fa-41da-4f76-b22d-83b07b86d7f4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.148513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7953fa-41da-4f76-b22d-83b07b86d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.148782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7953fa-41da-4f76-b22d-83b07b86d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.152951 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 617/1227] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.152951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369503-4903-4e6d-83ba-6673ff9f41ed None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.152951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369503-4903-4e6d-83ba-6673ff9f41ed None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.152951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1369503-4903-4e6d-83ba-6673ff9f41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.173023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-df7953fa-41da-4f76-b22d-83b07b86d7f4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.173394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c1369503-4903-4e6d-83ba-6673ff9f41ed None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.174229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-df7953fa-41da-4f76-b22d-83b07b86d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.174843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c1369503-4903-4e6d-83ba-6673ff9f41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.182521 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 611/1228] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.183829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e54-8aba-47a0-94bb-6096418334f2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.184108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e54-8aba-47a0-94bb-6096418334f2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.184375 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de5e54-8aba-47a0-94bb-6096418334f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.188971 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 618/1229] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.191155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.191659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.191934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.204257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a8de5e54-8aba-47a0-94bb-6096418334f2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.205478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a8de5e54-8aba-47a0-94bb-6096418334f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.211466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.212621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.213406 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 612/1230] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.214645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164fe41-b352-4c83-9826-ea0112ebbe2f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.214918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164fe41-b352-4c83-9826-ea0112ebbe2f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.215183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164fe41-b352-4c83-9826-ea0112ebbe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.220767 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 619/1231] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.221553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.232918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef8d19-bf1b-456b-a073-3be0dbe32768 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.235302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2164fe41-b352-4c83-9826-ea0112ebbe2f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.236469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2164fe41-b352-4c83-9826-ea0112ebbe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.237985 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.238576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.238850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.239113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.239740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.241395 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba76dc9-89e6-4153-9650-5ac9f2e95842 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.244244 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 613/1232] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.245484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d39-8940-4281-85d0-7e291b6aec82 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.245763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d39-8940-4281-85d0-7e291b6aec82 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.246026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c04d39-8940-4281-85d0-7e291b6aec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.254792 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 620/1233] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:55:59.254792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee82fc-e0ab-4089-9fbf-a7f74ce8e28e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.254792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee82fc-e0ab-4089-9fbf-a7f74ce8e28e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.254792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee82fc-e0ab-4089-9fbf-a7f74ce8e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.267296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-80c04d39-8940-4281-85d0-7e291b6aec82 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.268450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-80c04d39-8940-4281-85d0-7e291b6aec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.272312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c5ee82fc-e0ab-4089-9fbf-a7f74ce8e28e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.273569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c5ee82fc-e0ab-4089-9fbf-a7f74ce8e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.276530 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 614/1234] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.281624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.281767 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 621/1235] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.281939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.282214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.282898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.283174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.283435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.301545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.302193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.302717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.303328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.310593 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 615/1236] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.311417 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 622/1237] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.312129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.312936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.321923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacb22d-639f-4e1b-9ec7-dc73caca2adf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.324295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6fc95-518b-46f5-a3b3-ff6602e5aac5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.326366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.326952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.327223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.327486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.328111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.328458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.329593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.330104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.330219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.330458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.330730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.331375 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.331670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.332724 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:55:59.332724 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:55:59.332724 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:55:59.333647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.341468 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 623/1238] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.342319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.352124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38867517-cc89-41e0-84e3-1432571343cb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.352991 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 616/1239] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.353819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.357415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.358006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.358284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.358550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.359191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.359490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.361303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.364031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc70ca7-2322-4f37-889c-d27ae571dc7e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.368693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.369501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.369781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.370054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] PATH_INFO: `/v3/projects/f9ecfb8b74ec4e03bc149b1e1b56c356/users/3aca3737ea4c40a89384bdf5e77d90f5/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.378939 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 624/1240] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.378939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.385148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ecfb8b74ec4e03bc149b1e1b56c356, user_id=3aca3737ea4c40a89384bdf5e77d90f5, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.387886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.388627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21135-c88e-4dc7-bba5-243827c764c6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.393367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.393951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.394226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.394543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.395176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.395471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.397140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.401819 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 617/1241] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:55:59 2022] PUT /identity/v3/projects/f9ecfb8b74ec4e03bc149b1e1b56c356/users/3aca3737ea4c40a89384bdf5e77d90f5/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:55:59.402613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.410801 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 625/1242] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.411630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.421493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bc75b-8ba9-425d-87ac-e201d03a3b0d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.447881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:59.453054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:59.473948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae278-43a9-43b4-9038-638b84de3fc3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.479463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.480078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.480351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.480512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.480671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.481158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.481320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.481441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.481613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.481717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.482317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.482620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.483273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.484221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.496065 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 618/1243] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.496618 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 626/1244] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.497056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.497546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.507641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7edac5-e881-462c-9024-f686f403bf0f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.516602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.517326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.517605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.517861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.518534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.519345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec807d32-c3f2-4b8c-84f6-491c1b4ddf17 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.519579 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:55:59.519579 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:55:59.519579 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:55:59.520783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.523807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.524402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.524674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.524973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.525608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:55:59.525899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.527469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.540171 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 619/1245] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:55:59.541069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.551437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e4946-dd3f-49ef-8365-ebe6291e2bb1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.555406 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 627/1246] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.556212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.559280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.559949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.560284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.560554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.561244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.563210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b529c-82bc-4b74-a8fb-b9addfd93cef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.593101 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 620/1247] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.594963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.595248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.595521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.616986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:55:59.618190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:55:59.623217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac0da-52fc-40af-aedd-bcfbf8b42e17 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.678116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.678737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.679013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.679283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.680052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.680422 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 621/1248] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:55:59.681359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.681896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.695213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc5bf1-f410-4df8-a534-2f9c44c77e3f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.700607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.701272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.701553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.701815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.702451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.704458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.719425 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 628/1249] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.720344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.733483 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 622/1250] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.734308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.759440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:59.789698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00692-89e6-4364-be0d-ac43e7be3e4b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.793259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2399f80-709f-4d40-8317-18ad38c76dde admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.794363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.795030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.795245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.795505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.796133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.798131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.798264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.798750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.799019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.799387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.800008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.801990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.832022 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 629/1251] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.832022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.832332 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 623/1252] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.832332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.835210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:55:59.903092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4f5-3228-4dab-ae16-fe597b899f69 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.904529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc894cb-33d0-48d6-a400-84a98a9a3d9d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.907798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.908399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.908675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.908970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.909590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.909938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:55:59.910543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:55:59.910651 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:55:59.910651 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:55:59.910651 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:55:59.910898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:55:59.911076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:55:59.911702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:55:59.911813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.913746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:55:59.933718 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 624/1253] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.934531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:55:59.945644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11706-c22c-473a-b050-93c0d032791a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:55:59.947809 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 630/1254] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:55:59.948994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.002854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bf88c-52e6-406c-9433-e6666eecf132 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.004003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.004620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.004932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.005208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.005836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.006553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.007159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.007433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.007700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.007795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.017181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.018644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.028905 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 631/1255] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:00.029924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.032867 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 625/1256] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:55:59 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.033593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.043161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1f4df-37e1-4a69-921d-1640f52459a4 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.046062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151f363-8ecd-4ac4-8917-dd3c32a49d76 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.048660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.049311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.049597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.049848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.050496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.052646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.052795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.053712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.054131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.054566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.055248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.057370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.083065 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 632/1257] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.083065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.085194 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 626/1258] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.086884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.096126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22bc51-986a-41df-8a14-b374c2e632c8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.099472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61916b-28f1-43d6-973d-bc180025ff6f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.101959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.103720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.104003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.104404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.105173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.105978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.106581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.106848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.107111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.107227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.107732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.109751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.133880 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 627/1259] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.136268 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 633/1260] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/users => generated 284 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.136928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.137417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.147768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee30931-b91e-450d-9cd2-1f4e82f85c0f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.151205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497f4d-a955-4090-aabf-f186f5067612 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.152346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.153010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.153340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.153550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.154220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.155958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.157702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.158720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.159008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.159273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.159991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.162398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.166703 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 628/1261] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.170254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.175264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:00.184141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76da831-d5b9-4049-86da-e147c1f38b22 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.189348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.192953 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 634/1262] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:00.193104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.193104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.193104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.193345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.193419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.193419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.206340 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 629/1263] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.206340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.212544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f590ee-eb72-45d6-9b2a-be83148cfcfd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.217246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.217997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.218153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.218671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.219446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.221128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.229763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4f5d-4e60-47ac-b93e-2e37a3b835de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.233230 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 635/1264] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.234206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.235800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.236620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.236927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.237191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.237829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.239614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.244255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ce49-22cd-47ab-be85-2886093bc0e1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.249348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.250015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.250250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.250477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.251187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.251829 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 630/1265] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.253055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.255810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.264762 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 636/1266] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.265610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.267230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186879a6-bdd4-41dd-bd46-4a9d3bd5bf4e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.272203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.272864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.273150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.273523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.274041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.275790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.279858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af08a-32e0-41b5-a011-460b145d3e49 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.285673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.286284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.286701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.286809 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 631/1267] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.286889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.287491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.287605 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.289125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.292598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:00.297932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddebaf-da5f-49ae-ade5-83925a117949 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.304233 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 637/1268] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.304404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.305041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.305163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.305329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.305702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.306398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.308153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.314876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63831f2c-3b99-4d97-a81b-7b7133dad681 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.319460 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 632/1269] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.320276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.322723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.323348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.324146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.324146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.324506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.326123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.330007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf938d2b-fcee-4b4d-8ade-87f3646b693d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.334769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.335372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.335645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.335906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.336539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.338164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.341048 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 638/1270] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.341931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.349866 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 633/1271] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.352246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a5224-dde1-4592-a456-98a222f148eb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.354298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.357745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.358578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.359030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.359713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.360703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.363041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.364772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d51af8-4a65-4f5c-8b5b-2275eda91b24 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.369447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.370041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.370312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.370580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.371232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.372868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.375835 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 639/1272] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.379786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.383817 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 634/1273] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.384545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.390112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce9b5c-005f-4476-92ea-cfb7e303ac67 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.395684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.396289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.396424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9145aa1-1418-49af-a503-1f1ad365b8bc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.396615 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.396890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.397525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.399218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.401020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.401666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.401929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.402351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] PATH_INFO: `/v3/projects/dc6f4665bffb448f8e0db359038c1747/users/44f1c4e31f724cb3b0665b7743b17e8d/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.424316 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 640/1274] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.424316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.435785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d29d5-62f6-4430-88e4-34cea975a87b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.438825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6f4665bffb448f8e0db359038c1747, user_id=44f1c4e31f724cb3b0665b7743b17e8d, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.442015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.442282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.443212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.443644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.444066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.445670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.447437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.459266 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 641/1275] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:00.460451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.464995 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 635/1276] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/dc6f4665bffb448f8e0db359038c1747/users/44f1c4e31f724cb3b0665b7743b17e8d/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.466130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.477212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a929d1-ab37-4299-b270-5a8241e4c9c2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.542554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b66a0-c793-4722-ba76-0a65f66a6c74 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.547251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.547930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.548256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.548465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] PATH_INFO: `/v3/projects/4a2d5b3b740743ba9bba7dcf77214252/users/6538a3de44cd4650b31aab5f169a8abe/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.561513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.562195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.562478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.563174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] PATH_INFO: `/v3/projects/467164d5c9154ed5ad79e0257e95de97/users/63527c420b154db4abb6e832e46ccd05/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.565598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2d5b3b740743ba9bba7dcf77214252, user_id=6538a3de44cd4650b31aab5f169a8abe, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.568232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.582360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467164d5c9154ed5ad79e0257e95de97, user_id=63527c420b154db4abb6e832e46ccd05, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.585368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.589225 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 636/1277] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/4a2d5b3b740743ba9bba7dcf77214252/users/6538a3de44cd4650b31aab5f169a8abe/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.589225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.603229 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 642/1278] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/467164d5c9154ed5ad79e0257e95de97/users/63527c420b154db4abb6e832e46ccd05/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.605646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.666485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc8f80-29f3-46a6-81fc-bf1691b98442 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.672058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.672410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df44ac-576d-4fa5-88c8-d5398530ae29 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.673529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.673957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.674547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] PATH_INFO: `/v3/projects/5f559acdad6742ebbacac0270397bae4/users/f686d96701154da6a57ae338f37ce04d/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.677440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.678103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.678386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.678668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] PATH_INFO: `/v3/projects/b0d4b0c6d58647cc9edf3c402276ed76/users/9c31b55ae3e54ccab41f07f38401bd47/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.681054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:00.692530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f559acdad6742ebbacac0270397bae4, user_id=f686d96701154da6a57ae338f37ce04d, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.695542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.697704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d4b0c6d58647cc9edf3c402276ed76, user_id=9c31b55ae3e54ccab41f07f38401bd47, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.700410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.713479 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 637/1279] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/5f559acdad6742ebbacac0270397bae4/users/f686d96701154da6a57ae338f37ce04d/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.724781 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 643/1280] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/b0d4b0c6d58647cc9edf3c402276ed76/users/9c31b55ae3e54ccab41f07f38401bd47/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.724781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.725138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:00.739505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:00.801974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead73470-d6c3-48a7-a911-1f99844bb2ff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.816569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400b86d-11c4-479c-8e61-0b3203fc4b9e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:00.822043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.823019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.823623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.824122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] PATH_INFO: `/v3/projects/e74aa212631443488ea95f2730ab9d9a/users/2fbc075701fd4f3cb51dbdc9c504f7c1/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.824885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:00.825568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.825844 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.826122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] PATH_INFO: `/v3/projects/18cdea5418644c38bdff444de462b7c6/users/bb8be65b81ca4eee9a524ddb6577d188/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.844958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cdea5418644c38bdff444de462b7c6, user_id=bb8be65b81ca4eee9a524ddb6577d188, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.847780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb7c6b-2a7b-4830-a2df-bfce636a14fb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.850313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74aa212631443488ea95f2730ab9d9a, user_id=2fbc075701fd4f3cb51dbdc9c504f7c1, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:00.853521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d581a8-d176-4cd5-ab47-51adea7ffc7b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:00.863517 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 644/1281] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/18cdea5418644c38bdff444de462b7c6/users/bb8be65b81ca4eee9a524ddb6577d188/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.865234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1ddd-d6b4-46b2-a7b5-7e2c053c7770 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.865583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1ddd-d6b4-46b2-a7b5-7e2c053c7770 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.865919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea1ddd-d6b4-46b2-a7b5-7e2c053c7770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.876888 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 638/1282] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:00 2022] PUT /identity/v3/projects/e74aa212631443488ea95f2730ab9d9a/users/2fbc075701fd4f3cb51dbdc9c504f7c1/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:00.878043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22355e-6b03-4171-8b80-df32f3534fdd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.878329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22355e-6b03-4171-8b80-df32f3534fdd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.879025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22355e-6b03-4171-8b80-df32f3534fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.887144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-48ea1ddd-d6b4-46b2-a7b5-7e2c053c7770 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:00.888388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-48ea1ddd-d6b4-46b2-a7b5-7e2c053c7770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:00.901295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-be22355e-6b03-4171-8b80-df32f3534fdd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:00.906663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be22355e-6b03-4171-8b80-df32f3534fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:00.955460 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 645/1283] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:00.955460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47086d0-55b8-4114-b044-e59301de6df1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.955460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47086d0-55b8-4114-b044-e59301de6df1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.955460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47086d0-55b8-4114-b044-e59301de6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:00.982722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c47086d0-55b8-4114-b044-e59301de6df1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:00.984241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c47086d0-55b8-4114-b044-e59301de6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:00.984784 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 639/1284] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:00.987016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8796-eebd-4cd5-8b91-ede45c70139d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:00.987406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8796-eebd-4cd5-8b91-ede45c70139d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:00.987687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb8796-eebd-4cd5-8b91-ede45c70139d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.001464 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 646/1285] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:01.002938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377b6a-c080-462c-aa4a-e51362f17787 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.003221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377b6a-c080-462c-aa4a-e51362f17787 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.003490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0377b6a-c080-462c-aa4a-e51362f17787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.027949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-74bb8796-eebd-4cd5-8b91-ede45c70139d None None] MFA Rules not processed for user `f686d96701154da6a57ae338f37ce04d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:01.029215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-74bb8796-eebd-4cd5-8b91-ede45c70139d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:01.042570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c0377b6a-c080-462c-aa4a-e51362f17787 None None] MFA Rules not processed for user `9c31b55ae3e54ccab41f07f38401bd47`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:01.043796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c0377b6a-c080-462c-aa4a-e51362f17787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:01.116456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:01.127347 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 640/1286] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:01.127347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.127347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.127347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.148077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:01.149977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:01.158892 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 647/1287] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:01.159268 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 641/1288] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:01.160154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.161619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:01.172359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.172880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.173336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.183606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:01.208160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] MFA Rules not processed for user `2fbc075701fd4f3cb51dbdc9c504f7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:01.209869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:01.224435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde44410-6485-4cc6-b634-d1a816a2c783 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.229591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.230668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.230668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.230909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.242475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.244202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.257082 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 642/1289] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:01.258108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.267137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c23d59-64ce-4e0e-aea4-0ef310d75567 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.271525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.272627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.273037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.273397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.293987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.296427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.313518 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 643/1290] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:01.318027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.326463 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 648/1291] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:01.326463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.335712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9a695-21e1-494c-b5a3-54745f91230b service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.344342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.345001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.345285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.345554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.348674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bb474-5b97-425d-adb9-1503be911e3e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.358499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.359382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.360051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.360474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.361311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.363605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.368169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.370062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.395233 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 644/1292] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:01.396130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.412391 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 649/1293] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:01.413809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.468226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090eb18a-f54a-4e7e-8d50-b576f7c6e247 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.510392 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483a2e-273b-49cc-bac9-9e42fb2a1f28 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.517644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.519322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.519887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.520998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.570017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.570656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.572497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.572791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.700938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.707031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.745815 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 650/1294] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:01.749669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.754171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.758262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.771843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ef0dd-db8f-4020-88d0-6760dac9305d service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.772297 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 645/1295] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:01.773312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.782419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:01.787925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483002-8caf-4b19-a8a6-0e9e68afbf16 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.794852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.795425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.795799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.796268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.797196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.799587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.802377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.803419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.805189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.805546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.806834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.813073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.839666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:01.848293 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 646/1296] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/users => generated 309 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:01.859199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.872036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac4804-8046-40da-8f6a-481ebc661760 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:01.878439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:01.879062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:01.879333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:01.879737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:01.880655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:01.883893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:01.901028 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 647/1297] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:01.901998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.903404 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 651/1298] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:01.904537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:01.913708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8fd56-6d72-4d05-8ef3-ed8597f68613 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.045682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.050414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.050883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.051074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] PATH_INFO: `/v3/projects/0ea883ab2c0b47209a02274786095978/users/00985ca06f7743c2a7816dcd4f8bfe80/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.134809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea883ab2c0b47209a02274786095978, user_id=00985ca06f7743c2a7816dcd4f8bfe80, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.134809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.164816 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 648/1299] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:01 2022] PUT /identity/v3/projects/0ea883ab2c0b47209a02274786095978/users/00985ca06f7743c2a7816dcd4f8bfe80/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:02.172089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.180416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df6af4-ae7a-4afa-9a1a-1d5e7b3472c2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.318205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618baf-649f-4764-9154-b97f6b65b8c2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.328373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.329532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.329803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.330074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.330721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.333865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.335999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.337215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.337543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.337823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.338534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.340813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.359086 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 649/1300] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:02.360093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.383199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc48a3-7495-48b9-b678-0195e7a47744 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.386959 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 652/1301] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:01 2022] POST /identity/v3/users => generated 292 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:02.389867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.403217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.403914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.404191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.404462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] PATH_INFO: `/v3/projects/0ea883ab2c0b47209a02274786095978/users/00985ca06f7743c2a7816dcd4f8bfe80/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.411055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea883ab2c0b47209a02274786095978, user_id=00985ca06f7743c2a7816dcd4f8bfe80, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.413517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e4c18-5dc7-4590-8638-a6d46ac2103e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.417332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.421640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.422607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.423143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.423587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.424620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.428427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db08b3-b7a2-4c4f-9d33-a6c3e9d69b7d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.447788 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 650/1302] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:02 2022] PUT /identity/v3/projects/0ea883ab2c0b47209a02274786095978/users/00985ca06f7743c2a7816dcd4f8bfe80/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:02.449376 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 653/1303] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:02.449864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.462434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.463735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.465559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.552688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] MFA Rules not processed for user `00985ca06f7743c2a7816dcd4f8bfe80`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:02.556541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:02.578846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:02.623972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467493ed-e1b6-488c-95c1-03cbe530ad50 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.636122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.637016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.637451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.637904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] PATH_INFO: `/v3/projects/df4adbfa3b1e431292f1279a73558b11/users/a9a130c2211e4c6d8a462cfc5f52385f/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.673560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:02.677547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4adbfa3b1e431292f1279a73558b11, user_id=a9a130c2211e4c6d8a462cfc5f52385f, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.680619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.693858 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 654/1304] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:02 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:02.705954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.709666 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 651/1305] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:02 2022] PUT /identity/v3/projects/df4adbfa3b1e431292f1279a73558b11/users/a9a130c2211e4c6d8a462cfc5f52385f/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:02.710524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.877290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2d840-1939-438f-95de-bf3e2d23e870 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.877434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d6185-f1cd-4116-939c-182639405b12 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.900590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.901330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.901612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.901905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.902544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.904196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:02.931223 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 652/1306] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:02.935147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:02.955052 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8abcb1-2866-477f-b475-c139872f22d3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:02.972762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:02.973447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:02.973725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:02.974000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] PATH_INFO: `/v3/projects/df4adbfa3b1e431292f1279a73558b11/users/a9a130c2211e4c6d8a462cfc5f52385f/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:02.977933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4adbfa3b1e431292f1279a73558b11, user_id=a9a130c2211e4c6d8a462cfc5f52385f, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:02.980654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38915215-8ca2-4f0a-9599-2ee8fa766b4b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.007720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.008366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.008644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.008941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.028733 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 653/1307] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:02 2022] PUT /identity/v3/projects/df4adbfa3b1e431292f1279a73558b11/users/a9a130c2211e4c6d8a462cfc5f52385f/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:03.043210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5926473-aef5-4260-b064-ef4aa18a02c1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.043567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5926473-aef5-4260-b064-ef4aa18a02c1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.044111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5926473-aef5-4260-b064-ef4aa18a02c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.140820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c5926473-aef5-4260-b064-ef4aa18a02c1 None None] MFA Rules not processed for user `a9a130c2211e4c6d8a462cfc5f52385f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:03.142248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5926473-aef5-4260-b064-ef4aa18a02c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:03.205814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.207299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.230658 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 655/1308] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:03.304360 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 654/1309] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:03.321258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.332333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86c19f-b436-4997-bb51-03543bd8960d service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.378666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.378948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.379266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.443813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] MFA Rules not processed for user `44f1c4e31f724cb3b0665b7743b17e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:03.444789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:03.462915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.465222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.466941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.468057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.489359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.489902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:03.495856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.514102 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 656/1310] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:03.562128 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 655/1311] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:03.569303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.576324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:03.682837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.699049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331ba55-5d52-415e-b46f-0573f2324ddc service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.700104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ea1fc-0fe7-4250-8b73-97366c32b88b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.705049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.705680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.706164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.706774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.707038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.709589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.710942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.711593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.711869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.712193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.746947 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 657/1312] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:03 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:03.746947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.837316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.839160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.853128 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 656/1313] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:03.854411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.868772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e116-19fe-4d9a-bbaa-cd6a8fba110f service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.880764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.881996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912296a-d139-463d-91c4-edf066195e0b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.882428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.884420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.884912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.885721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.889467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.895601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.896380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.896720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.897091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] PATH_INFO: `/v3/users/f686d96701154da6a57ae338f37ce04d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.898335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f686d96701154da6a57ae338f37ce04d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:03.899440 dv-cinder-master-3-smb devstack@keystone.service[81465]: WARNING py.warnings [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:56:03.899440 dv-cinder-master-3-smb devstack@keystone.service[81465]: warnings.warn(msg) Oct 16 00:56:03.899440 dv-cinder-master-3-smb devstack@keystone.service[81465]: Oct 16 00:56:03.900821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:03.949109 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 657/1314] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:03 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:03.950444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:03.978282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977437c-6e49-4aa5-a16f-eb4aca0d521d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:03.983538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:03.984374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:03.984777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:03.990442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:03.997398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:04.002721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:04.020541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f686d96701154da6a57ae338f37ce04d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:04.023738 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 658/1315] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:04.029887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:04.042963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f686d96701154da6a57ae338f37ce04d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:04.060362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43512-1243-48a5-a73e-7b0e415352cd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:04.073261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:04.073946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.074215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.074475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] PATH_INFO: `/v3/projects/deb67f37aadf4554ae34d8066c4f21d5/users/87c9c7fa20c44d98b104e44070ef2f99/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.091794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f686d96701154da6a57ae338f37ce04d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:04.113803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f686d96701154da6a57ae338f37ce04d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:04.114167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb67f37aadf4554ae34d8066c4f21d5, user_id=87c9c7fa20c44d98b104e44070ef2f99, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:04.118048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51949446-609e-4468-81a4-b56c86aded06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f686d96701154da6a57ae338f37ce04d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:04.118420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:04.140936 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 658/1316] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:03 2022] DELETE /identity/v3/users/f686d96701154da6a57ae338f37ce04d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:04.140936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.140936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.140936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.151396 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 659/1317] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:04 2022] PUT /identity/v3/projects/deb67f37aadf4554ae34d8066c4f21d5/users/87c9c7fa20c44d98b104e44070ef2f99/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:04.157280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:04.159056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:04.188088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:04.189749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:04.195343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:04.279839 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9df5a1-6963-42c7-b098-9346a96e5ae2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:04.292501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:04.293827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.294113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.294390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.295048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:04.299942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:04.322199 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 659/1318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:04.329271 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 660/1319] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:04.331704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:04.341658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c77be-1213-4161-a7c3-3e785ab60713 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:04.373297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:04.375028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.377692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.378699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] PATH_INFO: `/v3/projects/deb67f37aadf4554ae34d8066c4f21d5/users/87c9c7fa20c44d98b104e44070ef2f99/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.385806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb67f37aadf4554ae34d8066c4f21d5, user_id=87c9c7fa20c44d98b104e44070ef2f99, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:04.387990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:04.390394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:04.392405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56244fa-dd73-4e8a-ae6f-a35b9d675fe4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:04.398215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:04.425394 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 660/1320] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:04 2022] PUT /identity/v3/projects/deb67f37aadf4554ae34d8066c4f21d5/users/87c9c7fa20c44d98b104e44070ef2f99/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:04.566783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2dc47-86da-47ca-9a06-5f3d248372f3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:04.638592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:04.639312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.640649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.641076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.753708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:04.755686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543c61e-01d9-46d0-80e4-128adab95adb service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:04.768740 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 661/1321] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:04.830145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875013-6de0-47ba-9f76-7719cc57c91c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.830692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875013-6de0-47ba-9f76-7719cc57c91c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.830692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875013-6de0-47ba-9f76-7719cc57c91c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.832520 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 661/1322] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:04.854194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8e33-1427-4886-a6cf-3533644cf7a5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:04.854715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8e33-1427-4886-a6cf-3533644cf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:04.855196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac8e33-1427-4886-a6cf-3533644cf7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:04.986731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6eac8e33-1427-4886-a6cf-3533644cf7a5 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:04.988229 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6eac8e33-1427-4886-a6cf-3533644cf7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:05.107491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:05.150336 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 662/1323] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:05.157102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:05.157353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:05.157639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:05.159772 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 662/1324] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 16 00:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:05.166088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:05.166609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:05.167115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:05.208693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:05.210480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:05.240159 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 663/1325] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:05.253703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:05.256270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:05.338157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d6504-8414-4829-acc8-9d05b1b5f126 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:05.343120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:05.343837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:05.344142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:05.344743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:05.358740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:05.360724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:05.375235 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 663/1326] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:07.289112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:07.290697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:07.315275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cc7f9-e632-4d79-a82f-10cf3823594c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:07.333663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:07.334612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:07.335049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:07.335613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] PATH_INFO: `/v3/projects/5f559acdad6742ebbacac0270397bae4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:07.337581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f559acdad6742ebbacac0270397bae4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:07.338816 dv-cinder-master-3-smb devstack@keystone.service[81466]: WARNING py.warnings [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 16 00:56:07.338816 dv-cinder-master-3-smb devstack@keystone.service[81466]: warnings.warn(msg) Oct 16 00:56:07.338816 dv-cinder-master-3-smb devstack@keystone.service[81466]: Oct 16 00:56:07.344820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:07.499094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f559acdad6742ebbacac0270397bae4', 'request_id': 'req-fe73db6a-83b6-41a0-a78c-955f1a823185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:07.516870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f559acdad6742ebbacac0270397bae4', 'request_id': 'req-fe73db6a-83b6-41a0-a78c-955f1a823185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:07.562319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f559acdad6742ebbacac0270397bae4', 'request_id': 'req-fe73db6a-83b6-41a0-a78c-955f1a823185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:07.593069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] The token cache is being invalidate because project 5f559acdad6742ebbacac0270397bae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:07.593367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:07.597395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-fe73db6a-83b6-41a0-a78c-955f1a823185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:07.603283 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 664/1327] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:07 2022] DELETE /identity/v3/projects/5f559acdad6742ebbacac0270397bae4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:07.605228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:07.617607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8f90c-9873-40fb-94dc-a6ee9c45076a service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:07.852909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:07.853710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:07.853947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:07.854215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] PATH_INFO: `/v3/users/00985ca06f7743c2a7816dcd4f8bfe80` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:07.856719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00985ca06f7743c2a7816dcd4f8bfe80)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:07.859377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:07.963648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:07.978958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00985ca06f7743c2a7816dcd4f8bfe80'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:08.003101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00985ca06f7743c2a7816dcd4f8bfe80'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:08.027959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00985ca06f7743c2a7816dcd4f8bfe80'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:08.049905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00985ca06f7743c2a7816dcd4f8bfe80'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:08.050668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-24947541-51e7-4882-8f78-058dc1d29c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00985ca06f7743c2a7816dcd4f8bfe80'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:08.068869 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 664/1328] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:07 2022] DELETE /identity/v3/users/00985ca06f7743c2a7816dcd4f8bfe80 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:08.359962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724888b9-ac1c-4b88-96ee-609238695d41 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.360556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724888b9-ac1c-4b88-96ee-609238695d41 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.360556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724888b9-ac1c-4b88-96ee-609238695d41 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.362386 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 665/1329] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:08.374559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471ec-37b0-4657-a6a9-bcd91a04cae9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.374871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471ec-37b0-4657-a6a9-bcd91a04cae9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.375204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9471ec-37b0-4657-a6a9-bcd91a04cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.422193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4c9471ec-37b0-4657-a6a9-bcd91a04cae9 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:08.423456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4c9471ec-37b0-4657-a6a9-bcd91a04cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:08.578139 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 665/1330] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:08.588514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20b16-e7fb-44b0-98bb-dfe4accf5d38 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.588799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20b16-e7fb-44b0-98bb-dfe4accf5d38 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.589096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20b16-e7fb-44b0-98bb-dfe4accf5d38 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.591141 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 666/1331] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 16 00:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:08.609058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.613826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.615222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.635277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.635566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.636043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.674933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:08.679015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:08.705971 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 666/1332] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:08.714770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] MFA Rules not processed for user `87c9c7fa20c44d98b104e44070ef2f99`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:08.716486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:08.720602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:08.722557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:08.905537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d0f40-ba5c-4815-b5a1-0acfbb4060a8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:08.914746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:08.917016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:08.917299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:08.917619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:08.944496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:08.947674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44118442-f0dd-493c-be13-0054cf2bb231 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:08.950784 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 667/1333] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:08.976769 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 667/1334] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:09.884145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:09.886631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:10.069612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:10.112012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1976471-330f-4f22-a60f-cba7feae7239 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:10.126271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:10.126957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:10.127228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:10.127494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] PATH_INFO: `/v3/projects/0ea883ab2c0b47209a02274786095978` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:10.134706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea883ab2c0b47209a02274786095978)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:10.136706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:10.278705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea883ab2c0b47209a02274786095978', 'request_id': 'req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:10.296211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea883ab2c0b47209a02274786095978', 'request_id': 'req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:10.313349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea883ab2c0b47209a02274786095978', 'request_id': 'req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:10.339885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] The token cache is being invalidate because project 0ea883ab2c0b47209a02274786095978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:10.340439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:10.341340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c42c2d1b-b041-48ee-ab77-b07d9a0d901f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:10.346850 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 668/1335] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:09 2022] DELETE /identity/v3/projects/0ea883ab2c0b47209a02274786095978 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:10.348536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:10.349046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:10.349150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:10.400476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:10.406704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:10.611389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:10.650135 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 668/1336] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:10.659231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:10.659859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:10.662451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:10.708860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:10.710115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:10.732673 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 669/1337] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:10.738083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:10.756971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d6fc-ed4c-420f-af7b-70552dc34d27 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:10.799706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:10.800674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:10.801149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:10.801569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:10.803068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:10.803548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:10.833561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:10.874242 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 669/1338] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:10.877810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:10.895560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b47f90-067e-4e14-90ea-93497812e046 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:10.911759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:10.913030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:10.913803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:10.914266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:10.915939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:10.918804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:10.972290 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 670/1339] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:10 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:10.975953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:10.993145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921448a3-28cc-4459-a269-2968890bb2c0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.147930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.148636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.149122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.149391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.150044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.152706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:11.217752 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 670/1340] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:10 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:11.219103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:11.236102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc5281-99cf-4cc8-bcb4-096e6668a85d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.246315 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.246944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.247218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.247487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.248137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.254068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:11.283295 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 671/1341] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:11.285387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:11.300405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726f4f7-555c-4344-aa15-8040083e511d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.310965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.311746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.312028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.312405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.313248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.316759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b23bfc-629b-4c6b-926a-251b8f4284ae admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:11.348885 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 671/1342] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:11.353012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:11.366049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d377a-e9a1-41e1-94a7-2a14f3b06a4f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.375874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.377074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.377996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.378488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] PATH_INFO: `/v3/projects/c197f9ebcab041f691f976760b905a9e/users/f8c789414bff45be88e307de30a37064/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.408172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c197f9ebcab041f691f976760b905a9e, user_id=f8c789414bff45be88e307de30a37064, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.411729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:11.446737 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 672/1343] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:11 2022] PUT /identity/v3/projects/c197f9ebcab041f691f976760b905a9e/users/f8c789414bff45be88e307de30a37064/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:11.448914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.449402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.450353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.523793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] MFA Rules not processed for user `f8c789414bff45be88e307de30a37064`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:11.525791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:11.622669 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 672/1344] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:11.626741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:11.747743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569211b-40cd-41b9-b718-26eeb1de0fd7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.753823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.754593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.755136 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.755541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.756439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.759254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:11.804356 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 673/1345] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:11 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:11.804563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:11.823677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d51f1-1743-4991-8adf-7f37cde198a7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:11.942420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:11.978172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:11.978804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:11.979083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:11.979356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:11.980008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:11.982154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:12.028203 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 673/1346] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:11 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:12.032299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:12.038074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:12.047790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ca20c-a561-45b0-8f7d-b107d08b03de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:12.059655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:12.060500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.060762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.062877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.065299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:12.067470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:12.103501 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 674/1347] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:12.107679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:12.120596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490f70c-3be4-4bc5-a63e-5a514a4c44e8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:12.133878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:12.134611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.134886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.135158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] PATH_INFO: `/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4/users/fe100fdeb5da4c2987f10d0b54c75242/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.177196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe4455de4434b94a7fd9c8db98b7dd4, user_id=fe100fdeb5da4c2987f10d0b54c75242, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:12.195767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:12.240379 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 674/1348] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:12 2022] PUT /identity/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4/users/fe100fdeb5da4c2987f10d0b54c75242/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:12.244704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:12.255403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d24f15-19f9-4d92-bb69-13fb1d2b0529 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:12.441871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:12.451867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.452154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.452423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.453256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:12.457448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7135e-6e47-4c66-bdc6-b8288431ffff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:12.484809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:12.496024 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 675/1349] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:12.498655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0db02c-7bc6-416a-b5e3-f532efbf8901 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:12.506856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:12.507533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.507804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.515304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] PATH_INFO: `/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4/users/fe100fdeb5da4c2987f10d0b54c75242/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.518642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe4455de4434b94a7fd9c8db98b7dd4, user_id=fe100fdeb5da4c2987f10d0b54c75242, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:12.521365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c04e2-3bf4-4bd6-92a7-215830c44c4c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:12.557671 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 675/1350] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:12 2022] PUT /identity/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4/users/fe100fdeb5da4c2987f10d0b54c75242/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:12.558874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.559331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.559755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.657784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] MFA Rules not processed for user `fe100fdeb5da4c2987f10d0b54c75242`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:12.659122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:12.755164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11a4-aa08-480e-8100-705c0e640983 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.757129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11a4-aa08-480e-8100-705c0e640983 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.759454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11a4-aa08-480e-8100-705c0e640983 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.761259 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 676/1351] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:56:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:12.863912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:12.864445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:12.864921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:12.882620 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 676/1352] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:12.919515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:12.921081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:12.926589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:12.929253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:13.102007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333df398-a196-4778-ae92-ddf92a6e17dd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:13.107167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:13.108693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:13.109018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:13.110145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:13.124535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:13.127444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:13.137240 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 677/1353] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:13.144502 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 677/1354] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:13.277858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:13.293801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea45d3f-4408-4043-82e8-2bc60d61a3c3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:13.300139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:13.301100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:13.301548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:13.302170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:13.414214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:13.416435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314da88-5d69-4dc0-bc75-98e7dbcafe68 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:13.416632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:13.419393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:13.431416 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 678/1355] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:13.439049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206f6cc-0e91-49ad-95b5-45fb4b2c1bed service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:13.445856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:13.446669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:13.448269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:13.448643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:13.464175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:13.466373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc35ba-4348-4baf-a139-daa716d7191b service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:13.479409 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 678/1356] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:13.828541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:13.828967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:13.829716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:13.885687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] MFA Rules not processed for user `3aca3737ea4c40a89384bdf5e77d90f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:13.887151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:13.924125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:14.007137 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 679/1357] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:14.019138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b464c-aa7c-403e-86e7-32e3db452479 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:14.019467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b464c-aa7c-403e-86e7-32e3db452479 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:14.019687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b464c-aa7c-403e-86e7-32e3db452479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:14.029996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:14.054216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dd5b464c-aa7c-403e-86e7-32e3db452479 None None] MFA Rules not processed for user `3aca3737ea4c40a89384bdf5e77d90f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:14.055496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd5b464c-aa7c-403e-86e7-32e3db452479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:14.067576 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 679/1358] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:14.084712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:14.084712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:14.300399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62a2d8-55b6-4fa9-ac30-b9f5e8cfa54c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:14.316391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:14.317055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:14.317332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:14.317602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:14.342979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:14.350340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e13e0-f3f2-4b7f-9813-793ff374e2c0 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:14.384240 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 680/1359] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:15.114564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46f17-1e9d-4488-978d-2f83284e502f None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.115543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46f17-1e9d-4488-978d-2f83284e502f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.115819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e46f17-1e9d-4488-978d-2f83284e502f None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.118530 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 680/1360] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:56:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:15.178895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3fd8-4e9b-4562-8a77-942943a44260 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.179487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3fd8-4e9b-4562-8a77-942943a44260 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.179593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f3fd8-4e9b-4562-8a77-942943a44260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.271073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5e8f3fd8-4e9b-4562-8a77-942943a44260 None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:15.278089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5e8f3fd8-4e9b-4562-8a77-942943a44260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:15.322061 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 681/1361] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:15.382613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e46f17-1e9d-4488-978d-2f83284e502f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:15.425902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e46f17-1e9d-4488-978d-2f83284e502f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:15.446776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:15.454352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.455042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.455825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.473213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.474987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.475809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.478246 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 682/1362] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 16 00:56:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:56:15.486554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:15.490431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:15.518804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:15.521468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebf2c9-ad0d-4a2d-ad45-41c732b05556 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:15.552408 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 681/1363] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:15.554350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.554859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.557890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.622255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:15.623861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:15.678668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9357ebd-b33e-48d6-9df3-f681833fcb6a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:15.683670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:15.684304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:15.684579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:15.684893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] PATH_INFO: `/v3/users/44f1c4e31f724cb3b0665b7743b17e8d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:15.689708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f1c4e31f724cb3b0665b7743b17e8d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:15.691557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:15.750374 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 682/1364] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:15.767981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:15.782299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f1c4e31f724cb3b0665b7743b17e8d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:15.795628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f1c4e31f724cb3b0665b7743b17e8d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:15.815576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f1c4e31f724cb3b0665b7743b17e8d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:15.836037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f1c4e31f724cb3b0665b7743b17e8d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:15.836883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f1c4e31f724cb3b0665b7743b17e8d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:15.858659 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 683/1365] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:15 2022] DELETE /identity/v3/users/44f1c4e31f724cb3b0665b7743b17e8d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:15.926026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:15.928656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:15.944072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1434f-f16c-4440-a177-0920472fc68e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:16.067954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:16.068621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:16.068932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:16.069209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:16.074533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:16.108338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:16.109960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba86701-9129-45ea-b423-4a40d0b966a3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:16.123329 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 683/1366] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:16.606454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:16.608568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:16.695237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:16.695763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:16.696623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:16.799642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] MFA Rules not processed for user `6538a3de44cd4650b31aab5f169a8abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:16.801727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:16.858621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2f774-6f96-4dd2-889b-89662db9defa admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:16.872768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:16.873456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:16.873728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:16.874005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] PATH_INFO: `/v3/users/9c31b55ae3e54ccab41f07f38401bd47` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:16.875339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c31b55ae3e54ccab41f07f38401bd47)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:16.877369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:16.979379 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 684/1367] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:16.988812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:16.990456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.004883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c31b55ae3e54ccab41f07f38401bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.022234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:17.023042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c31b55ae3e54ccab41f07f38401bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.054493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c31b55ae3e54ccab41f07f38401bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.081554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c31b55ae3e54ccab41f07f38401bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.082373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c31b55ae3e54ccab41f07f38401bd47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.100486 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 684/1368] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:16 2022] DELETE /identity/v3/users/9c31b55ae3e54ccab41f07f38401bd47 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:17.100486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:17.104244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.200791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:17.235715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb802c49-fe7d-4a13-bece-8821640472be None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:17.275551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5060-c58a-4141-b2dd-401aa89b7b9f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:17.289480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:17.290147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:17.290421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:17.290689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] PATH_INFO: `/v3/projects/dc6f4665bffb448f8e0db359038c1747` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:17.291858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6f4665bffb448f8e0db359038c1747)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:17.293820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:17.399266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6f4665bffb448f8e0db359038c1747', 'request_id': 'req-dff848d6-4003-4c32-a661-473234f613d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.419425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6f4665bffb448f8e0db359038c1747', 'request_id': 'req-dff848d6-4003-4c32-a661-473234f613d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.449664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6f4665bffb448f8e0db359038c1747', 'request_id': 'req-dff848d6-4003-4c32-a661-473234f613d2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.488059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] The token cache is being invalidate because project dc6f4665bffb448f8e0db359038c1747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:17.488357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.493300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-dff848d6-4003-4c32-a661-473234f613d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:17.505329 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 685/1369] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:17 2022] DELETE /identity/v3/projects/dc6f4665bffb448f8e0db359038c1747 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:17.506651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:17.506924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:17.507187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:17.601026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:17.607073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:17.607657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:17.608110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:17.618861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.624390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:17.628575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.882966 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 686/1370] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:17.897102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:17.898427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:17.899292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.903239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:17.926155 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 685/1371] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 938 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:17.927050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:17.931597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba1f2c-9738-4e88-aaff-8f73c077f4d4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:17.935873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:17.951302 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:17.953305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:17.953901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:17.954328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] PATH_INFO: `/v3/users/87c9c7fa20c44d98b104e44070ef2f99` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:17.959044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c9c7fa20c44d98b104e44070ef2f99)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:17.961259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:18.057846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:18.107299 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f7bff-ab9e-4f2e-9571-4a2862007ade service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:18.126266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c9c7fa20c44d98b104e44070ef2f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:18.153253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c9c7fa20c44d98b104e44070ef2f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:18.169160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:18.191382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:18.192013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:18.192278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:18.192541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:18.194365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:18.205168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c9c7fa20c44d98b104e44070ef2f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:18.208415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:18.231295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:18.240666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c9c7fa20c44d98b104e44070ef2f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:18.242850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c9c7fa20c44d98b104e44070ef2f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:18.243911 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 686/1372] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:18.244830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:18.255579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:18.278985 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 687/1373] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:17 2022] DELETE /identity/v3/users/87c9c7fa20c44d98b104e44070ef2f99 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:18.406498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba74d9-15c6-4c6f-a01e-43487afa6a12 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:18.579041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:18.579692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:18.579970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:18.580240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:18.585545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:18.691233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:18.720742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:18.722287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9159ba-20da-405b-a67e-af0cee520fa1 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:18.742076 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 687/1374] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:18.901401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:18.904249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:18.948159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da830cd-98ea-4585-95d1-e3622619c433 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:18.993456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:18.997100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:18.997497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:18.997776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] PATH_INFO: `/v3/projects/deb67f37aadf4554ae34d8066c4f21d5` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.005203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb67f37aadf4554ae34d8066c4f21d5)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:19.014016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:19.076764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6988-0cc3-44e4-9551-906494ad3c8b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.077078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6988-0cc3-44e4-9551-906494ad3c8b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.077364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f6988-0cc3-44e4-9551-906494ad3c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.240883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb67f37aadf4554ae34d8066c4f21d5', 'request_id': 'req-bcf58fef-0b30-4b50-8737-bc9f3f073992'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:19.257666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb67f37aadf4554ae34d8066c4f21d5', 'request_id': 'req-bcf58fef-0b30-4b50-8737-bc9f3f073992'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:19.260712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-745f6988-0cc3-44e4-9551-906494ad3c8b None None] MFA Rules not processed for user `bb8be65b81ca4eee9a524ddb6577d188`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:19.262002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-745f6988-0cc3-44e4-9551-906494ad3c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:19.284651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb67f37aadf4554ae34d8066c4f21d5', 'request_id': 'req-bcf58fef-0b30-4b50-8737-bc9f3f073992'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:19.325263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] The token cache is being invalidate because project deb67f37aadf4554ae34d8066c4f21d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:19.326306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:19.329962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bcf58fef-0b30-4b50-8737-bc9f3f073992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:19.356616 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 688/1375] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:18 2022] DELETE /identity/v3/projects/deb67f37aadf4554ae34d8066c4f21d5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:19.365024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e316588-5655-4080-b5e8-d7c52e8a6de6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.370020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e316588-5655-4080-b5e8-d7c52e8a6de6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.370596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e316588-5655-4080-b5e8-d7c52e8a6de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.441831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3e316588-5655-4080-b5e8-d7c52e8a6de6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:19.443295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3e316588-5655-4080-b5e8-d7c52e8a6de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:19.450924 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 688/1376] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:19.469631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.470125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.470536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.550582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] MFA Rules not processed for user `bb8be65b81ca4eee9a524ddb6577d188`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:19.555037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:19.585812 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 689/1377] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:19.598448 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 689/1378] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:19.599122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:19.600610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:19.608062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.608667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.609442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.660057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:19.668263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:19.699652 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 690/1379] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:19.704486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:19.746898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b008a4-318b-44e7-8592-dc3b0c44c29c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:19.768555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:19.769335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.769724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.770083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.770955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:19.771494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:19.773417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:19.818177 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 691/1380] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:19.829040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:19.840898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35ab01-3a2c-4b3b-aa22-5b2c6053657e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:19.862056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df5004-b0b7-4f70-80d4-44cc312048d9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:19.887562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:19.887562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.888898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:19.890852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:19.895365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.897722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.898303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:19.899274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:19.901112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:19.901449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:19.950428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:19.952405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077edae-3b8e-4536-a550-c26417a0144a service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:19.964858 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 692/1381] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:19.968948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.018335 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 690/1382] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:20.022958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:20.161484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.161822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.162101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.162677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8897daa-7f02-401b-a0d4-ccec3bf5cbe3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.215441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:20.216229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.218399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.218668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.219327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:20.234077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:20.261767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] MFA Rules not processed for user `63527c420b154db4abb6e832e46ccd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:20.263250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:20.323583 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 693/1383] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:19 2022] POST /identity/v3/users => generated 294 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:20.328196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.379830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e055b10-80e6-4999-91b2-0ed47283a0d6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.397474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:20.400886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.401498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.401782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.405139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:20.413636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:20.420514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:20.442773 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 694/1384] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:20.450861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.490605 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 691/1385] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:20.505285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82721e76-abfc-459f-b201-7147191ddf2f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.518164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:20.519950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.520226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.521637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.524412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:20.530463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:20.532943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.534557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:20.572950 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 695/1386] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:20.576823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.586347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:20.632044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6590e-831a-4254-a0b2-e98540b041ab admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.649709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:20.650169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.650439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.650703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] PATH_INFO: `/v3/projects/b0d4b0c6d58647cc9edf3c402276ed76` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.652460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d4b0c6d58647cc9edf3c402276ed76)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:20.655718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:20.755018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46951-c8dd-4cf0-9f3a-f24174d4d2d7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.764091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:20.764745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.765093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.765507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.779922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:20.782734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:20.803120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d4b0c6d58647cc9edf3c402276ed76', 'request_id': 'req-91e316f1-e480-4b92-8640-b791e35e6765'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:20.824056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d4b0c6d58647cc9edf3c402276ed76', 'request_id': 'req-91e316f1-e480-4b92-8640-b791e35e6765'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:20.836857 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 692/1387] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:20.837775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:20.844081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d4b0c6d58647cc9edf3c402276ed76', 'request_id': 'req-91e316f1-e480-4b92-8640-b791e35e6765'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:20.872065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2763a4-85c3-4f48-ba48-d75a5956e68c service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:20.874612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] The token cache is being invalidate because project b0d4b0c6d58647cc9edf3c402276ed76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:20.874904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:20.875634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-91e316f1-e480-4b92-8640-b791e35e6765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:20.879545 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 696/1388] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:20 2022] DELETE /identity/v3/projects/b0d4b0c6d58647cc9edf3c402276ed76 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:20.884348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ce9e-3835-4c6f-b9c5-1a9ca2b4cc5c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:20.884627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ce9e-3835-4c6f-b9c5-1a9ca2b4cc5c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:20.884928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368ce9e-3835-4c6f-b9c5-1a9ca2b4cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:20.957186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0368ce9e-3835-4c6f-b9c5-1a9ca2b4cc5c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:20.960725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0368ce9e-3835-4c6f-b9c5-1a9ca2b4cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.072211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:21.073377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.073794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.074201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] PATH_INFO: `/v3/projects/2a278e1921c34b25ade501c7acdc77ea/users/76b0f2b354014d0bb204dd9e73690631/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.115352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a278e1921c34b25ade501c7acdc77ea, user_id=76b0f2b354014d0bb204dd9e73690631, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:21.119963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c8728-e844-4d7b-808e-cd46f5b032fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:21.144264 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 693/1389] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:20 2022] PUT /identity/v3/projects/2a278e1921c34b25ade501c7acdc77ea/users/76b0f2b354014d0bb204dd9e73690631/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:21.159060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011a9c-c997-469f-ac87-903d7e44220b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.159401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011a9c-c997-469f-ac87-903d7e44220b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.159905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e011a9c-c997-469f-ac87-903d7e44220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.177104 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 697/1390] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:21.185073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db90f2-630b-4b16-bde8-e3eb4e81c4d7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.185629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db90f2-630b-4b16-bde8-e3eb4e81c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.185903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db90f2-630b-4b16-bde8-e3eb4e81c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.227436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-63db90f2-630b-4b16-bde8-e3eb4e81c4d7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:21.228744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-63db90f2-630b-4b16-bde8-e3eb4e81c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.231078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2e011a9c-c997-469f-ac87-903d7e44220b None None] MFA Rules not processed for user `76b0f2b354014d0bb204dd9e73690631`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:21.232600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2e011a9c-c997-469f-ac87-903d7e44220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.252625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:21.326565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:21.429678 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 698/1391] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:21.435150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8a04-6d2f-4660-ba80-d5bb5c0c14e8 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.435150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8a04-6d2f-4660-ba80-d5bb5c0c14e8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.438117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8a04-6d2f-4660-ba80-d5bb5c0c14e8 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.448384 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 699/1392] 10.222.0.13 () {54 vars in 912 bytes} [Sun Oct 16 00:56:21 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:21.450255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e8a04-6d2f-4660-ba80-d5bb5c0c14e8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:21.453490 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 694/1393] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:21.454901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.455338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.455658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.486219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:21.487931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.493209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e8a04-6d2f-4660-ba80-d5bb5c0c14e8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:21.525187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:21.527496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.527922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.528335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.533590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:21.534081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:21.535839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:21.566650 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 700/1394] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:21.567612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:21.573951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.598452 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8a64a-08e1-4716-92fc-49410e22c955 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:21.608545 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:21.609538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.609950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.610369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.611156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:21.613291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:21.620508 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 695/1395] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:21.621598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:21.639295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209bb43-ce38-45ef-b212-c22bc5dc0904 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:21.654046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:21.654869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.655390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.655822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:21.656577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:21.658699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:21.682102 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 701/1396] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:21.683077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:21.687241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:21.720951 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 696/1397] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:21.720951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:21.818085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de513ed7-95e4-446a-a89b-981b6317fd95 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:21.984775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:21.985900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:21.988767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:21.989903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.020148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.022594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.046854 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 702/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:22.048693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.180694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:22.239504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0539bd7-8bd2-4ba7-aade-77ed7db9bbf6 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.251731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.254385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.254553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.255358 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.257852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.264208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.273395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7862f-210e-442e-8a49-8dda835c4dc3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.281567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.283546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.283925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.284126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.287149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.294312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.323521 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 703/1399] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:22 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:22.330345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.349400 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 697/1400] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:21 2022] POST /identity/v3/users => generated 294 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:22.353931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.359906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d3004-5ecc-435f-bd24-fb3375725370 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.387199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.388082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.388441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.388783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.389333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4427195-a3ea-4b08-acfc-f474e3f942e5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.389601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.391391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.403352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.404068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.404409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.404932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.405855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.407531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.433169 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 698/1401] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:22.434540 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 704/1402] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:22.441378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.444073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.464995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51affb-9f10-4059-85f8-3a618f3688da admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.469779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34703ea-2523-4d36-afe7-d928bfa12e22 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.473608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.474580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.474942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.475312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.476149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.488707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.489528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.490151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.490496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.490761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.491403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.497391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.513999 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 705/1403] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:22.523781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.534741 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 699/1404] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:22.535227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.550958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826d89-9601-487d-9458-fac5162a22cd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.562121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56ccff-f10e-4f4f-a90d-b69c338c2d68 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.564978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.565734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.566143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.566520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] PATH_INFO: `/v3/projects/92a392f54af949faa84ffb9f13330ff1/users/d48641b6d3394a87a61029f18e799f71/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.580971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.580971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.580971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.580971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] PATH_INFO: `/v3/projects/2a4eca29fd134440bde9c68b95b9d258/users/45a6b441697b4b7296e6870ac9beb6ba/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.602935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a392f54af949faa84ffb9f13330ff1, user_id=d48641b6d3394a87a61029f18e799f71, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.608033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.634073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4eca29fd134440bde9c68b95b9d258, user_id=45a6b441697b4b7296e6870ac9beb6ba, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.637265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61368bac-49a3-4a41-b4b9-e43b678fcdbb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:22.641535 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 706/1405] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:22 2022] PUT /identity/v3/projects/92a392f54af949faa84ffb9f13330ff1/users/d48641b6d3394a87a61029f18e799f71/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:22.647814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:22.655056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:22.680047 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 700/1406] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:22 2022] PUT /identity/v3/projects/2a4eca29fd134440bde9c68b95b9d258/users/45a6b441697b4b7296e6870ac9beb6ba/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:22.682758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a33efc-7707-4573-8fa3-b54b6afb3c2d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.684721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a33efc-7707-4573-8fa3-b54b6afb3c2d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.685069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a33efc-7707-4573-8fa3-b54b6afb3c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.748769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:22.767175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c8a33efc-7707-4573-8fa3-b54b6afb3c2d None None] MFA Rules not processed for user `d48641b6d3394a87a61029f18e799f71`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:22.768470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c8a33efc-7707-4573-8fa3-b54b6afb3c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:22.869581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29133d-ece8-46d8-a2a9-e62135cddee1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:22.872456 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 701/1407] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:22.874589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ea11-b5c4-4d20-bb26-fc20b4ca90ea None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.875061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ea11-b5c4-4d20-bb26-fc20b4ca90ea None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.875458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ea11-b5c4-4d20-bb26-fc20b4ca90ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.948987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1773ea11-b5c4-4d20-bb26-fc20b4ca90ea None None] MFA Rules not processed for user `45a6b441697b4b7296e6870ac9beb6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:22.952530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1773ea11-b5c4-4d20-bb26-fc20b4ca90ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:22.956790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:22.959841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:22.960394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:22.962194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] PATH_INFO: `/v3/users/f8c789414bff45be88e307de30a37064` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:22.968377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c789414bff45be88e307de30a37064)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:22.970907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:23.038036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:23.080981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c789414bff45be88e307de30a37064'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:23.095258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c789414bff45be88e307de30a37064'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:23.104966 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 702/1408] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:23.107136 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.107425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.107697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.127056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c789414bff45be88e307de30a37064'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:23.158076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c789414bff45be88e307de30a37064'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:23.167380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c789414bff45be88e307de30a37064'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:23.192462 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 707/1409] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:22 2022] DELETE /identity/v3/users/f8c789414bff45be88e307de30a37064 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:23.197553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.200168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.267313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:23.273075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.406054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc22e1-058b-4cc0-9f3c-9e05b00f1d1e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:23.432644 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 703/1410] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:23.436419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.439254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.440775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:23.441607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.441996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.442326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.443051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:23.446382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd46fa-2d42-4fb5-8cfa-f70ef23793ef admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:23.486409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:23.508855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19bcce-2190-48fb-af25-e653386c0e5f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:23.529815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:23.534513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.535008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.538954 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 708/1411] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/projects => generated 379 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:23.538954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.538954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.538954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.540116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.542272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:23.547774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:23.571034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:23.576051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.605091 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 704/1412] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:23.606789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.728214 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 709/1413] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:23.732891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.752646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51202bcc-ac3d-4eb0-86fc-c7b422cfd79f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:23.758914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de78fe-bf6d-4d97-851c-dd4a045fd124 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:23.771495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:23.772257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.772404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.772643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.773083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:23.773708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:23.773840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:23.774143 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:23.774511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:23.775208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:23.777253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:23.778212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:23.831309 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 710/1414] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:23.832312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.835423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.837513 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 705/1415] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:23 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:23.838603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:23.841925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:23.882860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:24.057199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2444fd8-16b4-4146-b50f-44bd3c186602 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.078461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.083895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.083895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.083895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.126901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.128880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.150216 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 706/1416] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:24.151345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.169338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08ec70-67b3-48c2-90ce-ed7c69664872 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.181113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ebf37-5654-4627-a3c8-2ce135faf027 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.182425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.183087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.183362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.183634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.198647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.199652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.200137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.200590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.201472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.203367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.234078 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 707/1417] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:24.235352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.259506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a9b9-bd85-48cf-899d-57f0801a148b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.276279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.277119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.277395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.277666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.278365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.280072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.319134 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 708/1418] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:24.320143 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.340796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef8201-839a-4c48-8ec6-127bf65ca993 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.355283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.356441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.357075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.358854 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] PATH_INFO: `/v3/projects/847cd0a613af4787857dc385c31ad143/users/7e85a069d7704b4391ff755beca7f82c/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.380225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=847cd0a613af4787857dc385c31ad143, user_id=7e85a069d7704b4391ff755beca7f82c, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.383968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.393735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.400482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12a899-9476-413f-9ee2-5ef7166a2543 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.413816 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 709/1419] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:24 2022] PUT /identity/v3/projects/847cd0a613af4787857dc385c31ad143/users/7e85a069d7704b4391ff755beca7f82c/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:24.415691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.447769 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 711/1420] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 00:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:56:24.449312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.451756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.452051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.502800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:24.596072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] MFA Rules not processed for user `bb8be65b81ca4eee9a524ddb6577d188`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:24.603253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:24.608493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa83ea-57fb-46c2-a343-6251ebfe0aba admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.618996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.620171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.620609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.620907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] PATH_INFO: `/v3/projects/769bfa9473424e7bb2118934eab2ccbc/users/cce68897b6bf4a2591ae7e8b94e0e6d8/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.648333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769bfa9473424e7bb2118934eab2ccbc, user_id=cce68897b6bf4a2591ae7e8b94e0e6d8, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.651813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.709097 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 710/1421] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:24 2022] PUT /identity/v3/projects/769bfa9473424e7bb2118934eab2ccbc/users/cce68897b6bf4a2591ae7e8b94e0e6d8/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:24.710029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.860993 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 712/1422] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:24.868032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.919635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610a069-98f2-49e3-9f75-2e1d66b30e00 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.933426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.935546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.936002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.937353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.938195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.943904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:24.962680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17234867-ab4a-4f3a-9dfc-3dd30e326998 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:24.984732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:24.986258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:24.986537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:24.986803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:24.990799 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 713/1423] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:24.994228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:24.994835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:24.997548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:25.042865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76466620-0f0d-4f13-a2cd-af19284f8f3c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:25.057716 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 711/1424] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:25.061353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:25.062049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:25.062179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:25.067982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:25.069034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] PATH_INFO: `/v3/projects/769bfa9473424e7bb2118934eab2ccbc/users/cce68897b6bf4a2591ae7e8b94e0e6d8/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:25.076185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=769bfa9473424e7bb2118934eab2ccbc, user_id=cce68897b6bf4a2591ae7e8b94e0e6d8, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:25.091054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faea9d3-24f2-4f21-87f5-3db3318b9a1f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:25.102769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98183eae-3e0e-4db0-b32b-fb806f0f9152 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:25.117784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:25.120735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:25.122206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:25.123441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] PATH_INFO: `/v3/projects/847cd0a613af4787857dc385c31ad143/users/7e85a069d7704b4391ff755beca7f82c/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:25.133187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847cd0a613af4787857dc385c31ad143, user_id=7e85a069d7704b4391ff755beca7f82c, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:25.143869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f147-b696-4c1b-a869-0db850c888e1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:25.146537 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 714/1425] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:24 2022] PUT /identity/v3/projects/769bfa9473424e7bb2118934eab2ccbc/users/cce68897b6bf4a2591ae7e8b94e0e6d8/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:25.148179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:25.148467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:25.148740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:25.183918 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 712/1426] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:25 2022] PUT /identity/v3/projects/847cd0a613af4787857dc385c31ad143/users/7e85a069d7704b4391ff755beca7f82c/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:25.195335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:25.196483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:25.197438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:25.263251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] MFA Rules not processed for user `cce68897b6bf4a2591ae7e8b94e0e6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:25.268181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:25.290036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:25.299958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] MFA Rules not processed for user `7e85a069d7704b4391ff755beca7f82c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:25.305652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:25.619478 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 715/1427] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:25.628394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:25.630930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:25.745263 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 713/1428] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:25.756856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:25.758589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:25.842382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:25.870487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bc220-5bbf-4a5e-9895-446db6f40f09 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:25.884668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:25.885489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:25.885990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:25.886273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:25.891583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:26.019045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b7aa-545e-4ba1-9801-f941a209af9a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:26.029559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:26.030198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:26.030557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:26.035435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:26.067721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:26.071538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24274208-70b4-40f3-af7f-0eba01eddd45 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:26.085029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:26.089536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:26.115226 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 714/1429] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:26.132305 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 716/1430] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:26.147387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ece-5185-427b-9a9f-ab81056c0a41 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:26.147671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ece-5185-427b-9a9f-ab81056c0a41 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:26.147999 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b69ece-5185-427b-9a9f-ab81056c0a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:26.246424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-60b69ece-5185-427b-9a9f-ab81056c0a41 None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:26.251088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-60b69ece-5185-427b-9a9f-ab81056c0a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:26.473029 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 715/1431] 10.222.0.43 () {58 vars in 1015 bytes} [Sun Oct 16 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:26.489441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:26.491053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:26.526562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6cffa-e0c4-4141-9f8c-4aeb0c69884d service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:26.553937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:26.562428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:26.564564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:26.565030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:26.599769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:26.609466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:26.666809 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 717/1432] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:27.650383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:27.651085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:27.651448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:27.727828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] MFA Rules not processed for user `6538a3de44cd4650b31aab5f169a8abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:27.734046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:27.966456 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 716/1433] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:28.105522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:28.120655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13776c1d-bb6f-45fd-a388-a261cadfb698 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:28.151046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:28.151690 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:28.159052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:28.159720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:28.179900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:28.460881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:28.531523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:28.545566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:28.578817 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 718/1434] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:28.904733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:28.906112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:28.940534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:28.954365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce089-3168-4717-9f83-c9eba604a14e service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:28.962275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:28.963235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:28.963539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:28.963832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:29.012272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:29.016850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:29.054013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30fe2-077e-4998-9acc-ffa7080a551a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:29.063378 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 719/1435] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:29.066065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:29.067218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:29.067740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:29.068364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] PATH_INFO: `/v3/projects/c197f9ebcab041f691f976760b905a9e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:29.070285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c197f9ebcab041f691f976760b905a9e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:29.074791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:29.162593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:29.251965 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c197f9ebcab041f691f976760b905a9e', 'request_id': 'req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.269966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c197f9ebcab041f691f976760b905a9e', 'request_id': 'req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.287512 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c197f9ebcab041f691f976760b905a9e', 'request_id': 'req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.375573 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] The token cache is being invalidate because project c197f9ebcab041f691f976760b905a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:29.375972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.377555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-28c0a539-bf4f-48ca-a2f5-2fb06795ffd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.382906 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 717/1436] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:28 2022] DELETE /identity/v3/projects/c197f9ebcab041f691f976760b905a9e => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:29.386817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:29.420491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaeff3-2352-4689-9f33-12dbc9c0301c service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:29.692205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:29.694054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:29.695168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:29.696913 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] PATH_INFO: `/v3/users/fe100fdeb5da4c2987f10d0b54c75242` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:29.714311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9939-2022-4850-b13c-7897f93e720a None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:29.714716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9939-2022-4850-b13c-7897f93e720a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:29.715075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9939-2022-4850-b13c-7897f93e720a None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:29.717105 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 718/1437] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:56:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 16 00:56:29.718127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe100fdeb5da4c2987f10d0b54c75242)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:29.725061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:29.930315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe100fdeb5da4c2987f10d0b54c75242'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:29.981140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe100fdeb5da4c2987f10d0b54c75242'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:30.017057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe100fdeb5da4c2987f10d0b54c75242'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:30.045951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe100fdeb5da4c2987f10d0b54c75242'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:30.048108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe100fdeb5da4c2987f10d0b54c75242'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:30.059200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196ecb-c61c-4418-9566-166f400eb735 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:30.060142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196ecb-c61c-4418-9566-166f400eb735 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:30.060733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196ecb-c61c-4418-9566-166f400eb735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:30.065960 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 720/1438] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:29 2022] DELETE /identity/v3/users/fe100fdeb5da4c2987f10d0b54c75242 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:30.143727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-22196ecb-c61c-4418-9566-166f400eb735 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:30.145024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-22196ecb-c61c-4418-9566-166f400eb735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:30.325997 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 719/1439] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:56:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:31.584478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:31.594420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:31.699949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265e254-8975-4875-8b7c-541fdbb3f77b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:31.734090 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:31.741062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:31.741791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:31.742346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:31.769107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:31.771350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:31.813670 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 721/1440] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:32.740175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81841-3304-4b9e-bf1f-a130164beb49 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:32.741259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81841-3304-4b9e-bf1f-a130164beb49 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:32.741789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81841-3304-4b9e-bf1f-a130164beb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:32.823784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-48e81841-3304-4b9e-bf1f-a130164beb49 None None] MFA Rules not processed for user `63527c420b154db4abb6e832e46ccd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:32.830170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-48e81841-3304-4b9e-bf1f-a130164beb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:33.005369 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 720/1441] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:33.151149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:33.153329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:33.229604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:33.311196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503cb47-5315-438a-b58b-30af0cf9c3e9 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:33.331685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:33.332725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:33.333185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:33.333611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] PATH_INFO: `/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:33.337859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe4455de4434b94a7fd9c8db98b7dd4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:33.340006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:33.474718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe4455de4434b94a7fd9c8db98b7dd4', 'request_id': 'req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:33.495632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe4455de4434b94a7fd9c8db98b7dd4', 'request_id': 'req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:33.514388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe4455de4434b94a7fd9c8db98b7dd4', 'request_id': 'req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:33.543895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] The token cache is being invalidate because project 8fe4455de4434b94a7fd9c8db98b7dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:33.544201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:33.545709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-96d9e8b1-2a7e-4d8c-930c-da1fdc9bab9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:33.550207 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 722/1442] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:33 2022] DELETE /identity/v3/projects/8fe4455de4434b94a7fd9c8db98b7dd4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:33.555172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:33.555657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:33.555774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:33.625536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:33.627125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:33.778171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:33.874890 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 721/1443] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:33.879872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:33.880397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:33.880871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:33.985604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:33.998623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:34.030650 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 723/1444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:34.032155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:34.065318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c27d-860b-4ab2-8f9a-fa02f339afb1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:34.092958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:34.137692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:34.140778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:34.144475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:34.145313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:34.147957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:34.156637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:34.214280 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 722/1445] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:34.215185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:34.241836 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992add06-ffc8-4fb4-a26f-4c5113a02cdf None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:34.266313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:34.270048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:34.275122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:34.275569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:34.276357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:34.294854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:34.323298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:34.325698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:34.351251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e19d-09ab-4fad-8e4c-a98006482281 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:34.372790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:34.373794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:34.374468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:34.375130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] PATH_INFO: `/v3/users/d48641b6d3394a87a61029f18e799f71` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:34.377755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48641b6d3394a87a61029f18e799f71)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:34.381659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:34.437039 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 724/1446] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:34 2022] POST /identity/v3/projects => generated 389 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:34.438486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:34.580474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48641b6d3394a87a61029f18e799f71'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:34.582223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48641b6d3394a87a61029f18e799f71'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:34.602713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48641b6d3394a87a61029f18e799f71'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:34.637330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48641b6d3394a87a61029f18e799f71'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:34.660554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e07520ae-5168-45bf-831f-16588e4109ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48641b6d3394a87a61029f18e799f71'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:34.680638 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 723/1447] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:34 2022] DELETE /identity/v3/users/d48641b6d3394a87a61029f18e799f71 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:34.686463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:34.686735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:34.686993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:34.721790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a613-1285-4e87-9643-14ca448a36b7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:34.778348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:34.779743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:34.901789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:34.947158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:34.948062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:34.948670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:34.949157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:34.950325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:34.954364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.024251 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 725/1448] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:34 2022] POST /identity/v3/users => generated 295 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:35.025843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:35.027646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:35.068254 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 724/1449] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:35.072285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:35.076074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:35.130761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f18c4-bb0d-45ec-9e60-9156d4cf9038 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:35.146194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:35.146747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.147103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.147358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.148533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:35.150721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.182200 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 725/1450] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:35.183227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:35.202325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82df52-04fd-44ae-983f-58ce47350668 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:35.212398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b69271-3b8a-41e7-80ce-c4113fee1a90 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:35.212630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:35.213374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.213745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.214116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.221214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:35.225726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:35.226556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.226830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.229140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.229950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:35.237848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.269216 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 726/1451] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:35.275594 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:35.280522 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:35.361921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:35.366220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.367779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:35.401953 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 726/1452] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:35.404077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:35.441379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3068-b774-49bd-82c6-f1f83d50d976 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:35.460117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:35.461595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.461984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.462366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] PATH_INFO: `/v3/projects/e141a8e5c7ff4788971a518fb170e279/users/4517a9eba91e4dc5becfb0a841ac36d2/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.516643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ecec3-75d2-4550-ab05-fd713c1ba84f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:35.517846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e141a8e5c7ff4788971a518fb170e279, user_id=4517a9eba91e4dc5becfb0a841ac36d2, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:35.522946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73957006-62bd-4ac2-89d1-a46db5106237 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.528107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:35.530098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.532867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.535189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.564195 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 727/1453] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:35 2022] PUT /identity/v3/projects/e141a8e5c7ff4788971a518fb170e279/users/4517a9eba91e4dc5becfb0a841ac36d2/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:35.574888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:35.575595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:35.575957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:35.581765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:35.591821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:35.632380 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 727/1454] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:35.677474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] MFA Rules not processed for user `4517a9eba91e4dc5becfb0a841ac36d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:35.682612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:35.927577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:36.007730 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 728/1455] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:36.012684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:36.062634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe3bf5-0788-4577-a8a9-10ec86765c14 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:36.310132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:36.312930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:36.314692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:36.315259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:36.317436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:36.325097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:36.471185 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 728/1456] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:36 2022] POST /identity/v3/projects => generated 387 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:36.475818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:36.513028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d2cdd-3883-4290-a509-983cd16efc33 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:36.792271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:36.793339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:36.797339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:36.798185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:36.798994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:36.801525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:36.878619 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 729/1457] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:36 2022] POST /identity/v3/users => generated 300 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:36.883629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:36.915289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2173fc8-ec75-4cec-ac52-117092d65607 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:36.940365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:36.941089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:36.941411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:36.947049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:36.948012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:36.950021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:36.996931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:37.003743 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 729/1458] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:37.014839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2116a3d2-1bdf-4460-90b8-a555cd143c52 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:37.038599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:37.039372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:37.039661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:37.039939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] PATH_INFO: `/v3/projects/a901520d570049d9839ddf0b93a53149/users/9bb3b06941814293b00c84074c7238d3/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:37.094299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a901520d570049d9839ddf0b93a53149, user_id=9bb3b06941814293b00c84074c7238d3, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:37.097630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:37.128146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:37.141745 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 730/1459] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:36 2022] PUT /identity/v3/projects/a901520d570049d9839ddf0b93a53149/users/9bb3b06941814293b00c84074c7238d3/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:37.147667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c49446-db3d-44bb-81fb-ed466bb10012 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:37.379923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:37.380817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:37.381148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:37.381516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:37.382523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:37.398562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab575ab9-a9d9-4eec-8190-ae93499a74de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:37.479573 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 730/1460] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:37.481587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:37.497560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7247c4-a2f4-4541-a8fc-e25503f5a916 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:37.516142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:37.517570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:37.518132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:37.519827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] PATH_INFO: `/v3/projects/a901520d570049d9839ddf0b93a53149/users/9bb3b06941814293b00c84074c7238d3/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:37.527016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a901520d570049d9839ddf0b93a53149, user_id=9bb3b06941814293b00c84074c7238d3, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:37.536272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:37.573713 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 731/1461] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:37 2022] PUT /identity/v3/projects/a901520d570049d9839ddf0b93a53149/users/9bb3b06941814293b00c84074c7238d3/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:37.579303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:37.579798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:37.580265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:37.627202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] MFA Rules not processed for user `9bb3b06941814293b00c84074c7238d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:37.629228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:37.687885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:37.817285 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 731/1462] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:37.838956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:37.840893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:38.203865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a50382-c83a-42f6-b2c7-66ac3e522d6a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:38.229795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:38.231244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:38.231529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:38.236789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:38.296015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:38.308026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a8a3-bd55-47d7-aa51-8dad04c49c3d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:38.361250 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 732/1463] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:39.316378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:39.566332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f09b3d-fabd-4115-ae6a-3120d17a78ad None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:39.577657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:39.578566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:39.578994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:39.579478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] PATH_INFO: `/v3/users/4517a9eba91e4dc5becfb0a841ac36d2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:39.581322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4517a9eba91e4dc5becfb0a841ac36d2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:39.587381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:39.811475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4517a9eba91e4dc5becfb0a841ac36d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:39.813301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4517a9eba91e4dc5becfb0a841ac36d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:39.850686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4517a9eba91e4dc5becfb0a841ac36d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:39.896325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4517a9eba91e4dc5becfb0a841ac36d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:39.919386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4517a9eba91e4dc5becfb0a841ac36d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:39.962830 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 732/1464] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:39 2022] DELETE /identity/v3/users/4517a9eba91e4dc5becfb0a841ac36d2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:39.974990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:39.975989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:39.976498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:39.976627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:39.993288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.016318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:40.017793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.118795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:40.123388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:40.197811 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 733/1465] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:40.198948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:40.204265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.208804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9751b-a478-428b-b573-73c634e275d9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:40.223872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d67e2-9771-4cdc-b05e-4238bf7a56be None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:40.225602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:40.226535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:40.227394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:40.227821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] PATH_INFO: `/v3/users/76b0f2b354014d0bb204dd9e73690631` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:40.229398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b0f2b354014d0bb204dd9e73690631)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:40.229723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:40.230393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:40.230896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:40.231170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] PATH_INFO: `/v3/projects/92a392f54af949faa84ffb9f13330ff1` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:40.233123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a392f54af949faa84ffb9f13330ff1)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:40.234105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:40.235151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:40.338190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b0f2b354014d0bb204dd9e73690631'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.339002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b0f2b354014d0bb204dd9e73690631'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.340866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a392f54af949faa84ffb9f13330ff1', 'request_id': 'req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.351773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b0f2b354014d0bb204dd9e73690631'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.358429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a392f54af949faa84ffb9f13330ff1', 'request_id': 'req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.373600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a392f54af949faa84ffb9f13330ff1', 'request_id': 'req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.387382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b0f2b354014d0bb204dd9e73690631'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.399931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] The token cache is being invalidate because project 92a392f54af949faa84ffb9f13330ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:40.400224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.401294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.417722 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 734/1466] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:40 2022] DELETE /identity/v3/projects/92a392f54af949faa84ffb9f13330ff1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:40.423045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:40.425831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.429284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b0f2b354014d0bb204dd9e73690631'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.443113 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 733/1467] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:39 2022] DELETE /identity/v3/users/76b0f2b354014d0bb204dd9e73690631 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:40.444056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:40.451667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.559931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1688f-e1b3-4c21-b2ad-2ed58d803b48 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:40.581317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13631a0-10a2-4630-a844-2645cae94aaa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:40.593940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:40.594753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:40.595129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:40.595599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] PATH_INFO: `/v3/users/cce68897b6bf4a2591ae7e8b94e0e6d8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:40.596941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce68897b6bf4a2591ae7e8b94e0e6d8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:40.599036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:40.645596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:40.646387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:40.646670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:40.646967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:40.649173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.664414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:40.666212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53f889-3f5b-4e18-9294-9cabba264114 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:40.680785 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 735/1468] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:40.692659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:40.694956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:40.695264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:40.704851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce68897b6bf4a2591ae7e8b94e0e6d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.705561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce68897b6bf4a2591ae7e8b94e0e6d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.719382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce68897b6bf4a2591ae7e8b94e0e6d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.726624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:40.744683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce68897b6bf4a2591ae7e8b94e0e6d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.758099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce68897b6bf4a2591ae7e8b94e0e6d8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:40.765085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:40.765225 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 734/1469] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:40 2022] DELETE /identity/v3/users/cce68897b6bf4a2591ae7e8b94e0e6d8 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:40.766738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:40.802936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:41.026022 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 736/1470] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:41.049881 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.052148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:41.151062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.152557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:41.169183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4609d5-adea-4ca7-897b-219fc96c2b5a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.175288 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.175942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.176257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.177089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] PATH_INFO: `/v3/projects/e141a8e5c7ff4788971a518fb170e279` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.178680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e141a8e5c7ff4788971a518fb170e279)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.181083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.194525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc063-2215-4e37-a1d0-354625b8a6d3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.205920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.206591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.206899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.209086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.234782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.241046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.249252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e141a8e5c7ff4788971a518fb170e279', 'request_id': 'req-990bdc39-ca0b-48c8-82db-449d6488f43d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.255903 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 735/1471] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:41.256640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e141a8e5c7ff4788971a518fb170e279', 'request_id': 'req-990bdc39-ca0b-48c8-82db-449d6488f43d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.266051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e141a8e5c7ff4788971a518fb170e279', 'request_id': 'req-990bdc39-ca0b-48c8-82db-449d6488f43d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.280865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] The token cache is being invalidate because project e141a8e5c7ff4788971a518fb170e279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:41.281190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.281974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.284046 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 737/1472] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:41 2022] DELETE /identity/v3/projects/e141a8e5c7ff4788971a518fb170e279 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:41.288500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.299995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed6b4a-aefa-4881-8a38-5350125dcace service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.350471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.352193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:41.399939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.400870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.401414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.401805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] PATH_INFO: `/v3/users/9bb3b06941814293b00c84074c7238d3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.404365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb3b06941814293b00c84074c7238d3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.408046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.468125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bdc39-ca0b-48c8-82db-449d6488f43d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.472972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.473706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.473969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.474149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] PATH_INFO: `/v3/projects/769bfa9473424e7bb2118934eab2ccbc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.475276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=769bfa9473424e7bb2118934eab2ccbc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.477583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.480410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb3b06941814293b00c84074c7238d3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.481176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb3b06941814293b00c84074c7238d3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.492454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb3b06941814293b00c84074c7238d3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.508952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb3b06941814293b00c84074c7238d3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.518218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bb972606-a334-4300-9de8-5905d1580a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb3b06941814293b00c84074c7238d3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.520580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:41.532496 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 736/1473] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:41 2022] DELETE /identity/v3/users/9bb3b06941814293b00c84074c7238d3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:41.534655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769bfa9473424e7bb2118934eab2ccbc', 'request_id': 'req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.539359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:41.541806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769bfa9473424e7bb2118934eab2ccbc', 'request_id': 'req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.550048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769bfa9473424e7bb2118934eab2ccbc', 'request_id': 'req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.564223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] The token cache is being invalidate because project 769bfa9473424e7bb2118934eab2ccbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:41.564912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.565699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-90d73f44-29dc-4f8c-bf64-8cb0f086e54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:41.567823 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 738/1474] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:41 2022] DELETE /identity/v3/projects/769bfa9473424e7bb2118934eab2ccbc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:41.572676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.572985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.573266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.597036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:41.598362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:41.677284 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 737/1475] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:41.686779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.687066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.687401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.709829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:41.711211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:41.721345 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 739/1476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:41.724526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.735836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca04a-825d-49b9-9394-6f43746a9a04 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.741810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.742556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.742890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.743234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.743951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:41.745128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.747928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.771527 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 738/1477] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:41.772279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.797471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27226-ad79-486f-9e6c-4f7602d61428 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.818078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:41.821171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:41.821703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:41.823108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:41.823847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:41.827227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:41.869574 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 740/1478] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:41 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:41.873513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.887337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267c585-5039-4e5d-8a30-63877709f3fc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:41.943436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:41.945503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.039139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.039806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.040138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.040520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.041256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.043531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.082884 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 739/1479] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:41 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:42.087871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.123208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4063d-90e7-4d69-873d-cc94647d0f72 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.129984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65a5a0-f7e9-4d96-8247-5d4e292984cb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.134672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.135298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.136349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.137671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.138774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.140813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.143600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.144301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.144560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.144828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] PATH_INFO: `/v3/projects/2a278e1921c34b25ade501c7acdc77ea` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.148705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a278e1921c34b25ade501c7acdc77ea)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.153875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.166476 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 740/1480] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:42.171001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.199004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143ac3-a01d-4090-a741-baabc41e495c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.204015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.204883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.205344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.205520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.206226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.208504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.228121 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 741/1481] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:42.229131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.256336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44251b1d-0707-4057-bd81-f96717e70cf1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.258864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a278e1921c34b25ade501c7acdc77ea', 'request_id': 'req-679dc481-c5ed-4ccb-9167-19f65e7a8f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.289596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a278e1921c34b25ade501c7acdc77ea', 'request_id': 'req-679dc481-c5ed-4ccb-9167-19f65e7a8f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.306112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a278e1921c34b25ade501c7acdc77ea', 'request_id': 'req-679dc481-c5ed-4ccb-9167-19f65e7a8f99'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.336432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] The token cache is being invalidate because project 2a278e1921c34b25ade501c7acdc77ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:42.336731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.340691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.349742 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 741/1482] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:41 2022] DELETE /identity/v3/projects/2a278e1921c34b25ade501c7acdc77ea => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:42.350677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.354533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.370267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:42.383099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.383895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.384216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.386233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] PATH_INFO: `/v3/projects/2df571606305466799bcfda8551c296b/users/b533783587e1413881b0dd773100bf00/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.406580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df571606305466799bcfda8551c296b, user_id=b533783587e1413881b0dd773100bf00, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.411598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.440479 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 742/1483] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:42 2022] PUT /identity/v3/projects/2df571606305466799bcfda8551c296b/users/b533783587e1413881b0dd773100bf00/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:42.441385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.451572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.454248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:42.482515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dc481-c5ed-4ccb-9167-19f65e7a8f99 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.558089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.559813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.560223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.560961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] PATH_INFO: `/v3/projects/a901520d570049d9839ddf0b93a53149` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.562541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a901520d570049d9839ddf0b93a53149)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.563561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2612ad-78af-48b3-bac5-a313aacba8af admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.565348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.569051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.570257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.570257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.570658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] PATH_INFO: `/v3/users/45a6b441697b4b7296e6870ac9beb6ba` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.572038 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a6b441697b4b7296e6870ac9beb6ba)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.575138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.653382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a6b441697b4b7296e6870ac9beb6ba'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.653951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a901520d570049d9839ddf0b93a53149', 'request_id': 'req-afa26d36-6631-4e1b-a531-59632244193c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.656871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a6b441697b4b7296e6870ac9beb6ba'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.665339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a901520d570049d9839ddf0b93a53149', 'request_id': 'req-afa26d36-6631-4e1b-a531-59632244193c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.671398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a6b441697b4b7296e6870ac9beb6ba'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.689151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a901520d570049d9839ddf0b93a53149', 'request_id': 'req-afa26d36-6631-4e1b-a531-59632244193c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.696650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a6b441697b4b7296e6870ac9beb6ba'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.699629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] The token cache is being invalidate because project a901520d570049d9839ddf0b93a53149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:42.699920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.701198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-afa26d36-6631-4e1b-a531-59632244193c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.703876 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 742/1484] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:42 2022] DELETE /identity/v3/projects/a901520d570049d9839ddf0b93a53149 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:42.705081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.705364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.705619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.709871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13d4a4ea-adda-4232-82d8-a5db7922103d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a6b441697b4b7296e6870ac9beb6ba'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:42.717423 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 743/1485] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:42 2022] DELETE /identity/v3/users/45a6b441697b4b7296e6870ac9beb6ba => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:42.718868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1a74-beb5-4fe5-833d-d24fa2fe3607 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.719243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1a74-beb5-4fe5-833d-d24fa2fe3607 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.719602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f1a74-beb5-4fe5-833d-d24fa2fe3607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.744001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a6f1a74-beb5-4fe5-833d-d24fa2fe3607 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:42.745521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a6f1a74-beb5-4fe5-833d-d24fa2fe3607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.755403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] MFA Rules not processed for user `b533783587e1413881b0dd773100bf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:42.757054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.832374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:42.863252 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 744/1486] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:42.868607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.868851 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 743/1487] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:42.869641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.871116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.873153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.874859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.892018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ba2-abdf-4c94-9c7c-65771e43998f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.898779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:42.899712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:42.900250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:42.900714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:42.901885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:42.904057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:42.913043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:42.914281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:42.915904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:42.924753 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 745/1488] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:42.929256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:42.957259 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 744/1489] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:42 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:42.957954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce416e83-4235-466f-8bc9-97113759acd2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:42.959504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.062322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.063308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.063789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.064101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.064892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:43.065351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.067582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.084977 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 746/1490] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:43.095257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b09f7-c327-4d0a-9f5f-1542aed9f440 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.095853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.109267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.111027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.112936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.113612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.115164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.120216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc70a8-5e90-4fdc-b057-e1573d8b46cc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.121161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.126890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.128083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.128433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.129714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.130453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.132621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.154128 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 745/1491] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:42 2022] POST /identity/v3/users => generated 300 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:43.159252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.174683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48008f27-4842-4076-ae4f-6d18c47a3d14 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.181400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.182665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.183570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.183570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.184283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.186190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.199067 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 747/1492] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:43 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:43.203979 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 746/1493] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:43.204825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.208198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.223121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d7503-e0bb-4353-b09e-5500a41cfcd2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.300155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bef1e-98f6-4e6c-809e-8f989b2035ee admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.313111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.313798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.314072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.314422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] PATH_INFO: `/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98/users/d91288d9dc924c259b85ba69e6422b4e/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.316346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.317221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.317722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.318463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.319136 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.321912 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.333725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0380ada66bdc48c1b407d83fc5ddfc98, user_id=d91288d9dc924c259b85ba69e6422b4e, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.336997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.353788 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 748/1494] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:43 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:43.355759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.357386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:43.372029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e9523-f8b8-4a8e-adc9-5ddd9737168d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.375870 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 747/1495] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:43 2022] PUT /identity/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98/users/d91288d9dc924c259b85ba69e6422b4e/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:43.377110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.440692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:43.455635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.456328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.456572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.457391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] PATH_INFO: `/v3/projects/2a4eca29fd134440bde9c68b95b9d258` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.462973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4eca29fd134440bde9c68b95b9d258)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.462973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.477859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:43.499467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72109db4-9060-440e-94c3-48d48bb9dbd0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.505768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.506570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.506912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.507264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.508210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.510059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.534098 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 748/1496] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:43.536343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4eca29fd134440bde9c68b95b9d258', 'request_id': 'req-2733573c-7705-44f6-9fa0-afa18d9391f9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.537776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.544223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4eca29fd134440bde9c68b95b9d258', 'request_id': 'req-2733573c-7705-44f6-9fa0-afa18d9391f9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.554703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4eca29fd134440bde9c68b95b9d258', 'request_id': 'req-2733573c-7705-44f6-9fa0-afa18d9391f9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.565403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd94597-7dc3-47e6-b598-4b5eb52b4927 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.577265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] The token cache is being invalidate because project 2a4eca29fd134440bde9c68b95b9d258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:43.577564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.578365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.593276 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 749/1497] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:43 2022] DELETE /identity/v3/projects/2a4eca29fd134440bde9c68b95b9d258 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:43.594726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.601221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:43.672060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.672735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.673096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.673421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.674121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.675949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.688365 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 749/1498] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:43.689562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.691375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:43.716948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809ff0-38db-42ff-b61f-38a2c37b6d74 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.724124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.725205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.725491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.725760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] PATH_INFO: `/v3/users/7e85a069d7704b4391ff755beca7f82c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.727250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e85a069d7704b4391ff755beca7f82c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.727940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733573c-7705-44f6-9fa0-afa18d9391f9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.729219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.733483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.734376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.735080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.735524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.736363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.738203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.751363 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 750/1499] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:43.752598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.756434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:43.771380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d147a-b0bb-4a70-bac3-8f7bc9b09e1d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.776657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.777483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.777966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.778241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] PATH_INFO: `/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98/users/d91288d9dc924c259b85ba69e6422b4e/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.781004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0380ada66bdc48c1b407d83fc5ddfc98, user_id=d91288d9dc924c259b85ba69e6422b4e, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:43.784204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:43.793136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e85a069d7704b4391ff755beca7f82c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.799186 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 751/1500] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:43 2022] PUT /identity/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98/users/d91288d9dc924c259b85ba69e6422b4e/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:43.800362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:43.811130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e85a069d7704b4391ff755beca7f82c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.831583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e85a069d7704b4391ff755beca7f82c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.842116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e85a069d7704b4391ff755beca7f82c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.849409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-da0fa06b-1608-4cd2-ba66-d3a1c0260859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e85a069d7704b4391ff755beca7f82c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:43.857504 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 750/1501] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:43 2022] DELETE /identity/v3/users/7e85a069d7704b4391ff755beca7f82c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:43.859340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.859681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.860144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.898694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d1a43-bc34-4fb6-be26-ecc2e6280338 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:43.903921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] MFA Rules not processed for user `d91288d9dc924c259b85ba69e6422b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:43.905341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:43.910525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:43.968307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:43.971900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:43.972693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:43.973133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:43.973485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] PATH_INFO: `/v3/projects/925b11e4612b49f88fa6812d55e15c0c/users/b44fd5c928ea4a4289f24e6b825b98fa/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:43.999330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925b11e4612b49f88fa6812d55e15c0c, user_id=b44fd5c928ea4a4289f24e6b825b98fa, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.003100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0696d-bc43-4e43-a1de-41cdb46f4240 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.007192 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 751/1502] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:44.022083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.023764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.028511 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 752/1503] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:43 2022] PUT /identity/v3/projects/925b11e4612b49f88fa6812d55e15c0c/users/b44fd5c928ea4a4289f24e6b825b98fa/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:44.034276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.034619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.034905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.062101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:44.063507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.105368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae4f5-4ab7-4862-bcab-caa91176e854 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.146906 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 753/1504] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:44.156331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.157834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.164470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.165594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.165882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.166457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.231383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba3d7c-c07f-4860-8547-f74cc3ef2d55 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.235309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.236013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.236248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.236527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.246744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.247899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.248364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.249737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.260160 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 752/1505] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:44.260921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.262938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.271026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 754/1506] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:44.278708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62733e41-46e0-4035-ab90-69c48f3931e6 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.283359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.284097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.284266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.284521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] PATH_INFO: `/v3/projects/847cd0a613af4787857dc385c31ad143` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.288950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847cd0a613af4787857dc385c31ad143)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.294705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.351453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.354027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.392700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba49c8-5351-44f6-a601-b23053773579 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.393439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:44.403514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847cd0a613af4787857dc385c31ad143', 'request_id': 'req-4b950531-daab-47d9-a6cf-83414aa93794'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.413138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847cd0a613af4787857dc385c31ad143', 'request_id': 'req-4b950531-daab-47d9-a6cf-83414aa93794'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.421312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847cd0a613af4787857dc385c31ad143', 'request_id': 'req-4b950531-daab-47d9-a6cf-83414aa93794'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.440115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] The token cache is being invalidate because project 847cd0a613af4787857dc385c31ad143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:44.440460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.441226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4b950531-daab-47d9-a6cf-83414aa93794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.442746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:44.443299 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 753/1507] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:44 2022] DELETE /identity/v3/projects/847cd0a613af4787857dc385c31ad143 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:44.450756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516cad4-3abc-4a4c-ba1f-57dc79754cde None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.451131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516cad4-3abc-4a4c-ba1f-57dc79754cde None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.451468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516cad4-3abc-4a4c-ba1f-57dc79754cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.475169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.476158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.476669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.477472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] PATH_INFO: `/v3/users/b533783587e1413881b0dd773100bf00` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.478960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b533783587e1413881b0dd773100bf00)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.481457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.492641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d516cad4-3abc-4a4c-ba1f-57dc79754cde None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:44.493937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d516cad4-3abc-4a4c-ba1f-57dc79754cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.510863 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 754/1508] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:44.526939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.527313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.527597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.547961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b533783587e1413881b0dd773100bf00'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.549125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b533783587e1413881b0dd773100bf00'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.552708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:44.554634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.563077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b533783587e1413881b0dd773100bf00'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.566016 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 755/1509] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:44.570596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.578422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b533783587e1413881b0dd773100bf00'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.581786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac58015-0496-4548-a58b-b8d6c2769a2c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.590305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.591188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.591460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.591747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.592761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:44.593114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.594020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-839655a8-6c64-44ee-a4a2-a5077100f1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b533783587e1413881b0dd773100bf00'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:44.594861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.601232 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 755/1510] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:44 2022] DELETE /identity/v3/users/b533783587e1413881b0dd773100bf00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:44.606979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.607611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.607611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.612481 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 756/1511] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:44.616701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.618495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.630616 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:44.631784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125179a-3bdf-45ef-891a-f3fa5b514847 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.631931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.724975 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 756/1512] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:44.734687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.737935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:44.746097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.747353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.747629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.747894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.748539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.751802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.803732 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 757/1513] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/projects => generated 407 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:44.807592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:44.831812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c84a38-215a-4835-ba82-5e6ef0cb2462 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.845917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:44.912339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.914033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.914439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.914872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.935241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.938375 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:44.954997 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 757/1514] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:44.961857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985e981-0d70-4ea8-84ed-146d7ef813d4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:44.974539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:44.975320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:44.975600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:44.975867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:44.976515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:44.979018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.037071 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 758/1515] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:44 2022] POST /identity/v3/users => generated 304 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:45.044685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.068214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad593-bcaa-47ea-bb9c-f85233a61fc9 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.087676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.088369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.088755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.089231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.089882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.096155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.120499 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 758/1516] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:45.124668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.142923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ec9ba-353f-4c12-86a9-3d72ce09727a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.153175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.153776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.154139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.158288 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.158692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.161560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc5e30-04c6-4f9a-bd8a-935942a35f1f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.177681 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 759/1517] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:45.182596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.196180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbca11d-fb0c-4814-a225-e37f71758cd1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.201359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.202157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.202430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.202696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] PATH_INFO: `/v3/projects/def83571a56c4525acc134c2b9ac2aa5/users/f76cf73fb3e446378e55f63563febc91/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.236629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def83571a56c4525acc134c2b9ac2aa5, user_id=f76cf73fb3e446378e55f63563febc91, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.242825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.276927 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 759/1518] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:45 2022] PUT /identity/v3/projects/def83571a56c4525acc134c2b9ac2aa5/users/f76cf73fb3e446378e55f63563febc91/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:45.289653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.289945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.293861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.315692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:45.350512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] MFA Rules not processed for user `f76cf73fb3e446378e55f63563febc91`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:45.352925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:45.437645 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 760/1519] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:45.449887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.484463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.487048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:45.615726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe012-6140-40f7-8de2-cdf201b80f13 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.633530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9c81-8624-49e5-99d0-160d737e8c98 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.640628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.642060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.642550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.643093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] PATH_INFO: `/v3/users/2fbc075701fd4f3cb51dbdc9c504f7c1` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.644499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.644991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbc075701fd4f3cb51dbdc9c504f7c1)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.645161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.645441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.645715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.647971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.648343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.649949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.721984 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 760/1520] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:45 2022] POST /identity/v3/projects => generated 409 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:45.728775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.737271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbc075701fd4f3cb51dbdc9c504f7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.746436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbc075701fd4f3cb51dbdc9c504f7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.763789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbc075701fd4f3cb51dbdc9c504f7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.771691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbc075701fd4f3cb51dbdc9c504f7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.772538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbc075701fd4f3cb51dbdc9c504f7c1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.781958 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 761/1521] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:45 2022] DELETE /identity/v3/users/2fbc075701fd4f3cb51dbdc9c504f7c1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:45.781958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:45.781958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:45.809094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:45.854626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e07b7-06f1-48be-a6fb-d8de6d8b12e7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.866779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:45.890687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a2a21-819e-4842-bd22-149d38198f60 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:45.896419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.897417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.897883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.898492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] PATH_INFO: `/v3/projects/2df571606305466799bcfda8551c296b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.900868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df571606305466799bcfda8551c296b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.902935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.968603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df571606305466799bcfda8551c296b', 'request_id': 'req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.973837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:45.974687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:45.975031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:45.975362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:45.976075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:45.976688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df571606305466799bcfda8551c296b', 'request_id': 'req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:45.978706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208c2b6-da39-4525-81af-267d9932a2ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:45.986059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df571606305466799bcfda8551c296b', 'request_id': 'req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.013442 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 761/1522] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:45 2022] POST /identity/v3/users => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:46.013442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.013442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.013442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.021344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] The token cache is being invalidate because project 2df571606305466799bcfda8551c296b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:46.021862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.023639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4071cadd-cbed-4a0a-81dc-b0bea19e8c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.028514 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 762/1523] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:45 2022] DELETE /identity/v3/projects/2df571606305466799bcfda8551c296b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:46.029953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.030216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.030495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.042412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:46.043676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.067265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] MFA Rules not processed for user `b44fd5c928ea4a4289f24e6b825b98fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:46.070536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.122937 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 762/1524] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:46.123826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.125179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.137520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417347f-f388-4bbb-870f-f3329af812ef None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.142317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.142936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.143207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.143472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.144108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.145800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.156552 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 763/1525] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:46.160777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.161386 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 763/1526] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:46.162168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.163662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.165994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.178625 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971babd-90c1-4224-a717-404bc274294f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.183202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.183830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.184501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.184501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] PATH_INFO: `/v3/users/d91288d9dc924c259b85ba69e6422b4e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.185501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91288d9dc924c259b85ba69e6422b4e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.187493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.213389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:46.235225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab7f97-26a5-47cc-803f-996cd532c9a2 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.238423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91288d9dc924c259b85ba69e6422b4e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.238940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.239066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91288d9dc924c259b85ba69e6422b4e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.239557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.239815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.240073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.247092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91288d9dc924c259b85ba69e6422b4e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.249731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.251184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.258884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91288d9dc924c259b85ba69e6422b4e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.260664 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 764/1527] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:46.270549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.273955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91288d9dc924c259b85ba69e6422b4e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.281364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dfd95-499d-4585-9898-bb74f2910394 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.286523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.287194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.287468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.287757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] PATH_INFO: `/v3/projects/639d57434e9e4553815eae9a35024cac/users/da2416dfc225491c8185a5282b49db9f/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.292892 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 764/1528] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:46 2022] DELETE /identity/v3/users/d91288d9dc924c259b85ba69e6422b4e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:46.292892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.295084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.305498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:46.308069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639d57434e9e4553815eae9a35024cac, user_id=da2416dfc225491c8185a5282b49db9f, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.314252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.357213 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 765/1529] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:46 2022] PUT /identity/v3/projects/639d57434e9e4553815eae9a35024cac/users/da2416dfc225491c8185a5282b49db9f/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:46.359687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.364371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.420352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15383849-b4bd-42a9-9ed9-cb933c9569b0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.476007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d723f-a6f9-4cf3-b1e0-1c5fb2ccf0f1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.488083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.489297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.489513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.489779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.490431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.492092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.515344 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 766/1530] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:46.519704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.532860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b529f59-b935-421d-b853-f5eac41def19 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.538580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.539420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.539702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.540128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] PATH_INFO: `/v3/projects/639d57434e9e4553815eae9a35024cac/users/da2416dfc225491c8185a5282b49db9f/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.542264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] RBAC: Authorizing `identity:create_grant(project_id=639d57434e9e4553815eae9a35024cac, user_id=da2416dfc225491c8185a5282b49db9f, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.545083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b857-fe45-4445-b955-4fcb982c714a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.557051 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 767/1531] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:46 2022] PUT /identity/v3/projects/639d57434e9e4553815eae9a35024cac/users/da2416dfc225491c8185a5282b49db9f/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:46.567643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.567931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.568201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.568635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.569803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.570076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.570345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.571525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.573570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.625132 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 765/1532] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:46 2022] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:46.630127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.641915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] MFA Rules not processed for user `da2416dfc225491c8185a5282b49db9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:46.643176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.757313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8e54-bb1b-4ac6-a75d-909e5ae88f68 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.762114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.762731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.763006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.763275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.764287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.766394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.769918 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 768/1533] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:46.774343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.776733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.796699 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 766/1534] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:46 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:46.796699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.798229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6b60-b828-4a54-9b8b-3b70f2ef0285 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.798461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.804416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.805688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.806042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.806320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] PATH_INFO: `/v3/projects/e74aa212631443488ea95f2730ab9d9a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.807485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74aa212631443488ea95f2730ab9d9a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.810019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:46.831348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:46.837161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:46.869589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74aa212631443488ea95f2730ab9d9a', 'request_id': 'req-6c1e14d0-b5bb-4235-840a-4465c8962a45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.872611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907a08-58e4-4836-810c-ca1c869aa2de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.876025 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74aa212631443488ea95f2730ab9d9a', 'request_id': 'req-6c1e14d0-b5bb-4235-840a-4465c8962a45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.882995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74aa212631443488ea95f2730ab9d9a', 'request_id': 'req-6c1e14d0-b5bb-4235-840a-4465c8962a45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.897160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] The token cache is being invalidate because project e74aa212631443488ea95f2730ab9d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:46.897467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.898147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:46.899589 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 769/1535] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:46 2022] DELETE /identity/v3/projects/e74aa212631443488ea95f2730ab9d9a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:46.900815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:46.901826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.932298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.933105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.933536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.933816 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.935749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:46.979973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e14d0-b5bb-4235-840a-4465c8962a45 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:46.988034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:46.988662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:46.988969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:46.989224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:46.989924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:46.991478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.005588 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 770/1536] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:47.006772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.009181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.019231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.020877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.025177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303550eb-7ae9-452a-ba47-0ca879bc2ddb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.029975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.030614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.030883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.031244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] PATH_INFO: `/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.032241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0380ada66bdc48c1b407d83fc5ddfc98)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.035806 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 767/1537] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:47.036767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.038422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.039770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.056561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447b681-518a-407d-bc76-79caa76b6526 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.060763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.061548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.061845 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.062116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] PATH_INFO: `/v3/users/a9a130c2211e4c6d8a462cfc5f52385f` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.064442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9a130c2211e4c6d8a462cfc5f52385f)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.067626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.162730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0380ada66bdc48c1b407d83fc5ddfc98', 'request_id': 'req-6779b938-b456-474b-b76c-f5fdfeca97da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.176376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0380ada66bdc48c1b407d83fc5ddfc98', 'request_id': 'req-6779b938-b456-474b-b76c-f5fdfeca97da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.184370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9a130c2211e4c6d8a462cfc5f52385f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.185214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9a130c2211e4c6d8a462cfc5f52385f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.192399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0380ada66bdc48c1b407d83fc5ddfc98', 'request_id': 'req-6779b938-b456-474b-b76c-f5fdfeca97da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.200665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9a130c2211e4c6d8a462cfc5f52385f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.219040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] The token cache is being invalidate because project 0380ada66bdc48c1b407d83fc5ddfc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:47.219628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.220060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.223190 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 771/1538] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:47 2022] DELETE /identity/v3/projects/0380ada66bdc48c1b407d83fc5ddfc98 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:47.225213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.225439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9a130c2211e4c6d8a462cfc5f52385f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.230345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.238257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6d3d6cd6-e252-4a76-9a96-684e20042e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9a130c2211e4c6d8a462cfc5f52385f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:47.253465 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 768/1539] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:47 2022] DELETE /identity/v3/users/a9a130c2211e4c6d8a462cfc5f52385f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:47.253465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.253465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.255347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.272593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:47.294658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:47.295466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:47.295630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.395169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779b938-b456-474b-b76c-f5fdfeca97da admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.468127 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 769/1540] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:47.470382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.475765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.533801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.535380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.535740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.536080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] PATH_INFO: `/v3/projects/c1e115ef8d8f49068913fd64013f97f9/users/fe26bde03a294d6a9823c8962aa20d40/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.568271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e115ef8d8f49068913fd64013f97f9, user_id=fe26bde03a294d6a9823c8962aa20d40, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.571180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab7b73-e4bd-4180-8a12-16c10a696f70 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.582731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b05acd-04cd-4d92-b22a-e3a8ed5a6cad None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.587577 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 772/1541] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:47 2022] PUT /identity/v3/projects/c1e115ef8d8f49068913fd64013f97f9/users/fe26bde03a294d6a9823c8962aa20d40/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:47.588976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.589258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.589527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.612873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:47.613812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.660195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.661350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.662139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.664468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.667833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.699928 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 773/1542] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:47.700793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.702343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:47.719153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f2936-b378-4830-9576-2d4d56f4e424 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.724982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.725707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.726082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.726446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.727873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.730377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.743856 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 774/1543] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:47.745487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.750479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.752475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.757843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16987-f79f-4335-889b-a38eb655005e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.763981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.764804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.765248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.765635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.766388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:47.766788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.769110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.779363 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 770/1544] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:47.781941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.784118 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 775/1545] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:47.788201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.808649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ed44f-0d39-40cd-af37-82586d93a4aa service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.811443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836415-beea-4e7c-a06c-b048c7412743 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:47.816930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.817773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.818225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.818784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.819611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.822393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.823056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:47.823746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:47.824075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:47.824314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] PATH_INFO: `/v3/projects/c1e115ef8d8f49068913fd64013f97f9/users/fe26bde03a294d6a9823c8962aa20d40/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:47.830122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e115ef8d8f49068913fd64013f97f9, user_id=fe26bde03a294d6a9823c8962aa20d40, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:47.839270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:47.855398 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 771/1546] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:47 2022] PUT /identity/v3/projects/c1e115ef8d8f49068913fd64013f97f9/users/fe26bde03a294d6a9823c8962aa20d40/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:47.868413 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 776/1547] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:47 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:47.872506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:47.878237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:47.976474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd398180-8d89-4540-ac33-c55a66966e63 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.064871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.066065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.066698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.067048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.067829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.071121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.105280 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 772/1548] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:47 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:48.109807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.123513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ba54b-c46f-4af3-bc4e-d39f73869d4c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.130777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.131847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.132875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.133458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.134685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.137011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.140430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:48.175145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.184470 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 777/1549] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:48.189378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed77238-0238-4b27-bd5b-011b873b1b16 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.197956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.199441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.200203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.200671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.201920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.203910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945b81-7baf-4609-8f7b-0ed6a35fe2d4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.239419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.253052 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 773/1550] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:48.253975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f624-1102-4464-9a61-694c6e90b054 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.263734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.265502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.266931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.267950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] PATH_INFO: `/v3/projects/71ab1e7025924aaeb3145ede3f03846d/users/825d924762fa4525b3727e32baf9e29b/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.305319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ab1e7025924aaeb3145ede3f03846d, user_id=825d924762fa4525b3727e32baf9e29b, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.309156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.328717 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 778/1551] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:48 2022] PUT /identity/v3/projects/71ab1e7025924aaeb3145ede3f03846d/users/825d924762fa4525b3727e32baf9e29b/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:48.339481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.339777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.340870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.382873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] MFA Rules not processed for user `825d924762fa4525b3727e32baf9e29b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:48.389355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:48.525794 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 774/1552] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:48.528124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.543118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.544657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:48.588152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:48.662799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe1a12-7f4b-410c-854b-b23604412ddd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.669898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.671124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.671622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.672100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.672987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.676196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.683046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cd2c-c441-40b6-9765-ec80afe20a1d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.699883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.704594 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.704952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.705354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] PATH_INFO: `/v3/projects/df4adbfa3b1e431292f1279a73558b11` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.707619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4adbfa3b1e431292f1279a73558b11)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.715937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.730936 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 779/1553] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:48 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:48.732281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.817060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f0b80-c26d-453e-8ddf-67e7380cc35e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.839903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:48.842117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.842644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.843041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.852971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:48.856281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:48.888897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4adbfa3b1e431292f1279a73558b11', 'request_id': 'req-5345b631-90c0-49ec-96e6-62be9efb0a89'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:48.900873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4adbfa3b1e431292f1279a73558b11', 'request_id': 'req-5345b631-90c0-49ec-96e6-62be9efb0a89'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:48.902966 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 780/1554] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:48 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:48.907962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:48.915391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4adbfa3b1e431292f1279a73558b11', 'request_id': 'req-5345b631-90c0-49ec-96e6-62be9efb0a89'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:48.922834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce349a3-ff5c-46b7-83fb-1a62ea404920 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:48.937937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] The token cache is being invalidate because project df4adbfa3b1e431292f1279a73558b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:48.939147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:48.940466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5345b631-90c0-49ec-96e6-62be9efb0a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:48.942637 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 775/1555] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:48 2022] DELETE /identity/v3/projects/df4adbfa3b1e431292f1279a73558b11 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:48.947422 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125392d9-92fb-4a41-b127-25b0df249f42 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:48.948270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125392d9-92fb-4a41-b127-25b0df249f42 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:48.948913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125392d9-92fb-4a41-b127-25b0df249f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:48.981850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-125392d9-92fb-4a41-b127-25b0df249f42 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:48.983851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-125392d9-92fb-4a41-b127-25b0df249f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.017406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:49.041502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.041619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.041822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.042089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.042753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.044767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.077729 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 781/1556] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:49.081927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.104167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.123012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc07d6-7821-426a-9989-99b255b07fe7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.133007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.133546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.133859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.134130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] PATH_INFO: `/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d/users/2c13a05145614943b0143184c5869faf/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.143842 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 776/1557] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:49.151977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f94bb-667a-474c-9277-3e19bc8aaa4e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.152465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f94bb-667a-474c-9277-3e19bc8aaa4e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.153363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f94bb-667a-474c-9277-3e19bc8aaa4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.154308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c9b7b26dbf4e0ea0298caa3ec32f4d, user_id=2c13a05145614943b0143184c5869faf, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.157373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.181844 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 782/1558] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:49 2022] PUT /identity/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d/users/2c13a05145614943b0143184c5869faf/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:49.188368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.199984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-469f94bb-667a-474c-9277-3e19bc8aaa4e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:49.201850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-469f94bb-667a-474c-9277-3e19bc8aaa4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.304077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:49.314263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afa608-b6e3-4a4d-affe-b130689d9bf0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.329533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.330162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.330439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.330706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.331364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.337367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdbe57-1654-49ad-bd2f-fd5da961f9c6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.340262 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 777/1559] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:49.342178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266667e2-5cca-49d0-9c82-f0e0c9015213 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.342517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266667e2-5cca-49d0-9c82-f0e0c9015213 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.342810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266667e2-5cca-49d0-9c82-f0e0c9015213 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.351746 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 778/1560] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:56:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:49.353050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266667e2-5cca-49d0-9c82-f0e0c9015213 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.364724 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 783/1561] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:49.366461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38510a-3e57-4e1c-8580-074d56eb2c36 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.369253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38510a-3e57-4e1c-8580-074d56eb2c36 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.369877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38510a-3e57-4e1c-8580-074d56eb2c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.385098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266667e2-5cca-49d0-9c82-f0e0c9015213 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.392702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.393355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.393634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.393906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.394570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:49.394870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.396874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.399438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c38510a-3e57-4e1c-8580-074d56eb2c36 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:49.401919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c38510a-3e57-4e1c-8580-074d56eb2c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.431849 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 779/1562] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:49.432606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.446037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c67d-4c2c-45d4-974e-d6f5dacc85fc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.459015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.460029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.460509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.461705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] PATH_INFO: `/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d/users/2c13a05145614943b0143184c5869faf/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.464021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c9b7b26dbf4e0ea0298caa3ec32f4d, user_id=2c13a05145614943b0143184c5869faf, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.467653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.483247 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 780/1563] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:49 2022] PUT /identity/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d/users/2c13a05145614943b0143184c5869faf/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:49.484739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.567800 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 784/1564] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:49.569470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.569867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.570370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.642290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] MFA Rules not processed for user `2c13a05145614943b0143184c5869faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:49.646073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.721348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf37e3-9b80-468e-9167-02c522b2ea5e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.735654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:49.737645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:49.739781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:49.741344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:49.742872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:49.750475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:49.757075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:49.827704 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 781/1565] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:49.827704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.829437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:49.889139 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 785/1566] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:49.889139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:49.917273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970dfa3-0f22-436a-bd86-994a8225038a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:49.991741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e40441-bde6-42a3-a3f3-7e8715ae77ff admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.005707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.006747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.007030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.007301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.021530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.024625 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.037162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.038264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.038579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.038848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.039512 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.039977 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 782/1567] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:50.040859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.043309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.058718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.099356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.116630 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 786/1568] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:49 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:50.123363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.136906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6c31-05dd-4005-9095-b433f2a179e3 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.147226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab929-ced3-48e4-9edb-dc4cdf2687d9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.148311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.148958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.149277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.149493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.152948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.154104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.154104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.154296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.154987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.156694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.172533 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 787/1569] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:50.173600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.187265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402378d-2c67-4dc8-82cb-832915c32b25 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.195680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.196322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.196603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.196900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.197580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.199192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.219328 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 788/1570] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:50.220114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.240549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e71c-86f7-4c09-a024-cbc2d14356a7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.256610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.261384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.261736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.262016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] PATH_INFO: `/v3/projects/84740f36379b4254aee38d4dff1304c4/users/e2066768606e4de290fe7c9004635224/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.286073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.286073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665135f9-8ddc-4938-838a-a799b97991f9 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.293888 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 783/1571] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:50.295582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.296103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.296685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.297397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84740f36379b4254aee38d4dff1304c4, user_id=e2066768606e4de290fe7c9004635224, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.300281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a56e4a-c9cb-49e6-8453-10814f467e09 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.322043 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 789/1572] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:50 2022] PUT /identity/v3/projects/84740f36379b4254aee38d4dff1304c4/users/e2066768606e4de290fe7c9004635224/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:50.336592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829857-b174-4e67-8bc9-4636a5c91805 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.336783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829857-b174-4e67-8bc9-4636a5c91805 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.337284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829857-b174-4e67-8bc9-4636a5c91805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.338633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] MFA Rules not processed for user `fe26bde03a294d6a9823c8962aa20d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.340324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.385411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43829857-b174-4e67-8bc9-4636a5c91805 None None] MFA Rules not processed for user `e2066768606e4de290fe7c9004635224`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.388291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43829857-b174-4e67-8bc9-4636a5c91805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.451790 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 784/1573] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:50.461110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.461110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.489558 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 790/1574] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:50.491099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.491382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.491645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.506637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.516868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] MFA Rules not processed for user `b44fd5c928ea4a4289f24e6b825b98fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:50.518140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.537092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d861e-cc1a-436a-853b-c640badc3269 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.541068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.541766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.542036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.542301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.544163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.565681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.574409 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 791/1575] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:50.575232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.606212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.607589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.616421 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 785/1576] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:50.617251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.618741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.642485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69b1e3-905a-4399-bdaf-2df683a9f268 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.647002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.647604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.647876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.648138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.648760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.650848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.686264 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 792/1577] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:50.690355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.709085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a56a2-3eaf-4f89-bf50-4fc1463560cc service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.758793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05be1b-dfab-4bfc-861d-1bd067116019 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.764265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.765152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.765432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.765694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.766506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.768645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.788467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.789117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.789604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.789710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.792163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:50.801615 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 793/1578] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:50 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:50.802528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.815178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c7d3b-ed59-40b4-afe6-c3205900ac89 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.820610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.821813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.822123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.822416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.823160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.825721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.841018 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 794/1579] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:50.843392 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.859968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1725d-38d7-4bc5-aff3-9bf6c2cd0979 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:50.865921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:50.866614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:50.866868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:50.867501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] PATH_INFO: `/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b/users/c7f0769de76a483f8e3f89a9df753ae0/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:50.893584 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.895374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.915840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.919045 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 786/1580] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:50.919168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:50.930845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922f7fc7f15d420f8f8f9b1835acc08b, user_id=c7f0769de76a483f8e3f89a9df753ae0, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:50.933875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:50.978075 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 795/1581] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:50 2022] PUT /identity/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b/users/c7f0769de76a483f8e3f89a9df753ae0/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:50.980988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:50.995779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e130d-ea0c-428c-a3d8-290d7ec9a8a0 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:51.128005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:51.128944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.129433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.129855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.130691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:51.132590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6065e4-2087-4214-8c49-1eab8c7226be admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:51.149677 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 787/1582] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:51.162591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:51.194256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f07a2-7d18-4104-a2d6-3e65d01cf665 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:51.213893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:51.214893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.215225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.215502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] PATH_INFO: `/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b/users/c7f0769de76a483f8e3f89a9df753ae0/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.221658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922f7fc7f15d420f8f8f9b1835acc08b, user_id=c7f0769de76a483f8e3f89a9df753ae0, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:51.224823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:51.260247 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 796/1583] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:51 2022] PUT /identity/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b/users/c7f0769de76a483f8e3f89a9df753ae0/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:51.265833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.266393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.266862 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.331312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] MFA Rules not processed for user `c7f0769de76a483f8e3f89a9df753ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:51.332994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:51.498656 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 788/1584] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:51.517189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:51.606010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e6db3-180a-4c5a-94a8-68b36d2fae93 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:51.611238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:51.612667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:51.613000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:51.614075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:51.629149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:51.631491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:51.665791 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 797/1585] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:52.126778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:52.136772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61001c-1fdb-4412-906f-a34757b761d5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:52.142147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f0769de76a483f8e3f89a9df753ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '922f7fc7f15d420f8f8f9b1835acc08b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:52.142882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:52.143161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:52.143444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:52.144106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:52.144415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:52.146071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:52.161557 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 789/1586] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:52.163226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:52.174567 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3134e03-2b88-40fd-8a8e-00aa0f32923d service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:52.179414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f0769de76a483f8e3f89a9df753ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '922f7fc7f15d420f8f8f9b1835acc08b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:52.180135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:52.180473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:52.180979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:52.181694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:52.183666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:52.217475 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 798/1587] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:52 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:52.219871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:52.241333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04954cd7-5d55-4961-adc3-07d2129d2d72 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:52.308905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f0769de76a483f8e3f89a9df753ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '922f7fc7f15d420f8f8f9b1835acc08b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:52.309694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:52.310113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:52.310591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:52.311643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:52.312097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:52.314652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:52.326452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:52.331099 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 790/1588] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:56:52.389017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:52.391312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98003851-ccc1-4097-a554-79a9926575b7 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:52.407983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7f0769de76a483f8e3f89a9df753ae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '922f7fc7f15d420f8f8f9b1835acc08b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:52.408642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:52.408958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:52.409232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] PATH_INFO: `/v3/projects/f80ae2c4e3a34a98b6bc0ea080f32079` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:52.410627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f80ae2c4e3a34a98b6bc0ea080f32079)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:52.412547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:52.511372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80ae2c4e3a34a98b6bc0ea080f32079', 'request_id': 'req-b4d09641-0237-4f29-8e52-200c57661522'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:52.521547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80ae2c4e3a34a98b6bc0ea080f32079', 'request_id': 'req-b4d09641-0237-4f29-8e52-200c57661522'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:52.530349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80ae2c4e3a34a98b6bc0ea080f32079', 'request_id': 'req-b4d09641-0237-4f29-8e52-200c57661522'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:52.547293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] The token cache is being invalidate because project f80ae2c4e3a34a98b6bc0ea080f32079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:52.547742 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:52.548584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b4d09641-0237-4f29-8e52-200c57661522 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:52.550798 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 799/1589] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:52 2022] DELETE /identity/v3/projects/f80ae2c4e3a34a98b6bc0ea080f32079 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:52.981239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:52.983276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.098430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d698-4baa-4803-9fe0-9f5cb98198a0 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.099177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d698-4baa-4803-9fe0-9f5cb98198a0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.099708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d698-4baa-4803-9fe0-9f5cb98198a0 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.101662 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 800/1590] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:56:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:56:53.134468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.135698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.136487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.169703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19231311-9b96-4720-a90a-5adf6d5c91f0 tempest-VolumeQuotaClassesTest-1341485912 tempest-VolumeQuotaClassesTest-1341485912-project-admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:53.173776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:53.177154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.232778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:53.273865 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 801/1591] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:53.289478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:53.291020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.305392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:53.306142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.306457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.306725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] PATH_INFO: `/v3/users/e2066768606e4de290fe7c9004635224` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.307955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2066768606e4de290fe7c9004635224)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:53.308896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983de50-d92d-4020-a299-6390fc73e694 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:53.310018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:53.316688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:53.317346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.317978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.318306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.331956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:53.336319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5aee3-5abd-4ac8-b8ce-8cd7670ccd38 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:53.361777 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 802/1592] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:53.380474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2066768606e4de290fe7c9004635224'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:53.381246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2066768606e4de290fe7c9004635224'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:53.392409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2066768606e4de290fe7c9004635224'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:53.410988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2066768606e4de290fe7c9004635224'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:53.419999 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2066768606e4de290fe7c9004635224'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:53.430847 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 791/1593] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:52 2022] DELETE /identity/v3/users/e2066768606e4de290fe7c9004635224 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:53.437033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.437403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.437680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.458218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:53.459433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.530358 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 803/1594] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:53.540550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:53.542006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.575057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:53.624716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cd744-4d27-4983-b761-f69405921ce0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:53.630830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:53.631650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.631935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.632206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.643880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:53.645417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:53.656547 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 792/1595] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:53.971341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:53.972714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:53.987979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc907e-6902-4318-8f17-5eea4dbb755d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:53.992811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:53.993569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:53.993910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:53.994245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] PATH_INFO: `/v3/projects/84740f36379b4254aee38d4dff1304c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:53.995569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84740f36379b4254aee38d4dff1304c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:53.997625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:54.054365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84740f36379b4254aee38d4dff1304c4', 'request_id': 'req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.062341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84740f36379b4254aee38d4dff1304c4', 'request_id': 'req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.068821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84740f36379b4254aee38d4dff1304c4', 'request_id': 'req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.081983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] The token cache is being invalidate because project 84740f36379b4254aee38d4dff1304c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:54.082272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.083022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.087708 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 804/1596] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:53 2022] DELETE /identity/v3/projects/84740f36379b4254aee38d4dff1304c4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:54.088986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:54.099029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d0a9-cdfe-4c30-8aa2-e984156d5072 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:54.158099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:54.158785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.159065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.159333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] PATH_INFO: `/v3/users/c7f0769de76a483f8e3f89a9df753ae0` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.160494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f0769de76a483f8e3f89a9df753ae0)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:54.162511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:54.212141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f0769de76a483f8e3f89a9df753ae0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.213587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f0769de76a483f8e3f89a9df753ae0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.223313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f0769de76a483f8e3f89a9df753ae0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.238703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f0769de76a483f8e3f89a9df753ae0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.247788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-872d5667-5918-4313-9031-9689329f4e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f0769de76a483f8e3f89a9df753ae0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.256034 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 793/1597] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:54 2022] DELETE /identity/v3/users/c7f0769de76a483f8e3f89a9df753ae0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:54.326401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:54.328062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.343297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc73ad-cc23-4673-ad7d-57c952ccd4d1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:54.395145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:54.416185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:54.416757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.417057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.417322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] PATH_INFO: `/v3/users/f76cf73fb3e446378e55f63563febc91` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.418451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f76cf73fb3e446378e55f63563febc91)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:54.420407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:54.474564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f76cf73fb3e446378e55f63563febc91'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.482701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f76cf73fb3e446378e55f63563febc91'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.495739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f76cf73fb3e446378e55f63563febc91'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.504493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f76cf73fb3e446378e55f63563febc91'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.505342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f76cf73fb3e446378e55f63563febc91'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.512466 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 805/1598] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:54 2022] DELETE /identity/v3/users/f76cf73fb3e446378e55f63563febc91 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:54.517239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.517608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.517880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.539611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:54.540993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.586828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:54.588422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.599073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:54.652302 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 794/1599] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:54.670358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:54.673684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.701639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b347a-19fb-4552-b7b7-9d2a2520ac4f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:54.710267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:54.721730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.721730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.724421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] PATH_INFO: `/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.727925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922f7fc7f15d420f8f8f9b1835acc08b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:54.731460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:54.766834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db27f2-a42d-42b0-9e60-2ad4b433b6b4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:54.771120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:54.771859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.772235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.772600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.784051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:54.785945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9b278-90af-4da3-abd3-33a888e76e2b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:54.800732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922f7fc7f15d420f8f8f9b1835acc08b', 'request_id': 'req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.807731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922f7fc7f15d420f8f8f9b1835acc08b', 'request_id': 'req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.809053 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 795/1600] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:54.820764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922f7fc7f15d420f8f8f9b1835acc08b', 'request_id': 'req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.826014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:54.840900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] The token cache is being invalidate because project 922f7fc7f15d420f8f8f9b1835acc08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:54.841468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.842496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:54.849219 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 806/1601] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:54 2022] DELETE /identity/v3/projects/922f7fc7f15d420f8f8f9b1835acc08b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:54.854206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a079c4-4714-4bab-83bd-f2406b2241cb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:54.854537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a079c4-4714-4bab-83bd-f2406b2241cb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:54.854781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a079c4-4714-4bab-83bd-f2406b2241cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:54.901596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-64a079c4-4714-4bab-83bd-f2406b2241cb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:54.901719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:54.902857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64a079c4-4714-4bab-83bd-f2406b2241cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.906864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:54.997086 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 796/1602] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:54.998143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4593267-ba3e-4dc9-9f9a-f84f2a52e947 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.005683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.005970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.006268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.008648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.009320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.009597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.009869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] PATH_INFO: `/v3/users/825d924762fa4525b3727e32baf9e29b` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.012537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825d924762fa4525b3727e32baf9e29b)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.016790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.062146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:55.066235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.098956 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 797/1603] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:55.129569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.142239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825d924762fa4525b3727e32baf9e29b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.151098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdfab5-bcc4-4f0c-bf5f-7927e697d8fc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.158156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.158772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.159048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.159307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.160359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:55.162641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.162902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.164251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825d924762fa4525b3727e32baf9e29b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.184412 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 798/1604] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:55.185615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.208239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554ddb5-1e93-44a9-8194-37af3cf2ad35 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.212600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825d924762fa4525b3727e32baf9e29b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.220704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.220704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.220704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.220704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.221480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.223188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.228756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825d924762fa4525b3727e32baf9e29b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.230139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-54788f1d-824b-44d7-9e98-894a41886f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825d924762fa4525b3727e32baf9e29b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.244355 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 807/1605] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:54 2022] DELETE /identity/v3/users/825d924762fa4525b3727e32baf9e29b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:55.250105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.250831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.251303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.295479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:55.297819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.298538 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 799/1606] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:55 2022] POST /identity/v3/projects => generated 367 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:55.300542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.304738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.431083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:55.467518 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 808/1607] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:55.473318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.474461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233422-7681-45c0-b4f4-52a0bc4d6c0a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.475917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.498234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.499236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.500936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.500936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.500936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.502463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.512204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e678c77-830e-431b-bc15-9de41309f9f5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.521672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.522559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.523371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.523652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] PATH_INFO: `/v3/projects/def83571a56c4525acc134c2b9ac2aa5` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.528076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def83571a56c4525acc134c2b9ac2aa5)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.531428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.544989 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 800/1608] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:55 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:55.544989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.547792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.548879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:55.634880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def83571a56c4525acc134c2b9ac2aa5', 'request_id': 'req-3d153193-a3d4-4be0-95cb-578ebe5c9d57'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.643189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def83571a56c4525acc134c2b9ac2aa5', 'request_id': 'req-3d153193-a3d4-4be0-95cb-578ebe5c9d57'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.655224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def83571a56c4525acc134c2b9ac2aa5', 'request_id': 'req-3d153193-a3d4-4be0-95cb-578ebe5c9d57'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.658349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54652c25-e4db-4d90-8122-36d534c9d0d2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.678201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] The token cache is being invalidate because project def83571a56c4525acc134c2b9ac2aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:55.679144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.681278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.687490 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 809/1609] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:55 2022] DELETE /identity/v3/projects/def83571a56c4525acc134c2b9ac2aa5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:55.688441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.690391 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.790246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.791125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.791533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.792045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.799989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153193-a3d4-4be0-95cb-578ebe5c9d57 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.803134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.806865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.807610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.808158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.808874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.809375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.812507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.825540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.826963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.829814 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 810/1610] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:55.830797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.832989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:55.848982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bb9c2-7c62-4ba9-a278-429d8ab356df admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.850300 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 801/1611] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:55.851150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.854456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.855206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.855489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.855759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] PATH_INFO: `/v3/users/da2416dfc225491c8185a5282b49db9f` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.857077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2416dfc225491c8185a5282b49db9f)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.859945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.868276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10231bb-9b90-4596-96a2-6f77b24ddcea service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.876249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.877200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.877472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.877743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.878657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.880284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.894559 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 802/1612] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:55.898848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:55.916733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fabf0-306e-470b-9b60-90106242fdc5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:55.922673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:55.922862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2416dfc225491c8185a5282b49db9f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.923497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.923771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.924039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] PATH_INFO: `/v3/projects/917d783d602245ee907f0a472e3d5165/users/e7ad3ba93b6941b1b1f2d4fb9cc7117e/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.942872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917d783d602245ee907f0a472e3d5165, user_id=e7ad3ba93b6941b1b1f2d4fb9cc7117e, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:55.945444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2416dfc225491c8185a5282b49db9f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.946840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfdbe6-01fd-43ff-b384-d440e4920806 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:55.966758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2416dfc225491c8185a5282b49db9f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.970986 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 803/1613] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:55 2022] PUT /identity/v3/projects/917d783d602245ee907f0a472e3d5165/users/e7ad3ba93b6941b1b1f2d4fb9cc7117e/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:55.976121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2416dfc225491c8185a5282b49db9f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.977310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2416dfc225491c8185a5282b49db9f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:55.983372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:55.983651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:55.984364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:55.985530 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 811/1614] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:55 2022] DELETE /identity/v3/users/da2416dfc225491c8185a5282b49db9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:56.013764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] MFA Rules not processed for user `e7ad3ba93b6941b1b1f2d4fb9cc7117e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:56.015281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.113399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.127812 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 804/1615] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:56.132014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.133819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.141144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.242118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3fc5-5541-4fbd-9866-c5a1f59a1c0f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.247053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.247932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.248344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.248657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.249347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.251275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.282181 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 812/1616] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:56.287558 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.304708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4abfa-2fed-463e-8f96-d1f0bef9aa63 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.359874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.362023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.432329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.432985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.433267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.433528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.434171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.436208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.481022 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 805/1617] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:56.482373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.507618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f040ab-6c2a-4a7a-aca0-9019f95e17d2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.510382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffef08-5d60-4f7c-909b-046a57933035 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.514937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.515769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.515863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.516017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.516367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.516468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.516677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.517000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] PATH_INFO: `/v3/projects/71ab1e7025924aaeb3145ede3f03846d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.517968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.518382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ab1e7025924aaeb3145ede3f03846d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.520413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.520525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.534184 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 806/1618] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:56.535454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.537503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.566302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7bed0-8ec3-446e-bb7f-01a016b9fdca admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.573146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.573812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.574089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.574357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] PATH_INFO: `/v3/projects/639d57434e9e4553815eae9a35024cac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.575523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639d57434e9e4553815eae9a35024cac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.577698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.595190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ab1e7025924aaeb3145ede3f03846d', 'request_id': 'req-b275f559-e8cf-4ce7-a303-9d414d263f2c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.605268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ab1e7025924aaeb3145ede3f03846d', 'request_id': 'req-b275f559-e8cf-4ce7-a303-9d414d263f2c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.612306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ab1e7025924aaeb3145ede3f03846d', 'request_id': 'req-b275f559-e8cf-4ce7-a303-9d414d263f2c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.628359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] The token cache is being invalidate because project 71ab1e7025924aaeb3145ede3f03846d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:56.628647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.629339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.630909 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 813/1619] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:56 2022] DELETE /identity/v3/projects/71ab1e7025924aaeb3145ede3f03846d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:56.631632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.633920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.640716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639d57434e9e4553815eae9a35024cac', 'request_id': 'req-08e64e97-cc12-4563-bb3d-3f167642ddb4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.647361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639d57434e9e4553815eae9a35024cac', 'request_id': 'req-08e64e97-cc12-4563-bb3d-3f167642ddb4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.655160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639d57434e9e4553815eae9a35024cac', 'request_id': 'req-08e64e97-cc12-4563-bb3d-3f167642ddb4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.660662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.671788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] The token cache is being invalidate because project 639d57434e9e4553815eae9a35024cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:56.672275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.673129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.674870 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 807/1620] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:56 2022] DELETE /identity/v3/projects/639d57434e9e4553815eae9a35024cac => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:56.676365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.677793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.716049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275f559-e8cf-4ce7-a303-9d414d263f2c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.743790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:56.749474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e64e97-cc12-4563-bb3d-3f167642ddb4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:56.755818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.756613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.756984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.757317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] PATH_INFO: `/v3/users/2c13a05145614943b0143184c5869faf` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.758619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c13a05145614943b0143184c5869faf)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.761336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.783017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:56.783949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.784223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.784494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] PATH_INFO: `/v3/projects/31eed3c7098b4d5396a521bb89289f23/users/1c8bc9704cf94b5595b78c9091f05a09/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.801672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31eed3c7098b4d5396a521bb89289f23, user_id=1c8bc9704cf94b5595b78c9091f05a09, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:56.804642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a128e5-cf82-4b9f-95cb-e8c00fbfeae3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:56.819702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c13a05145614943b0143184c5869faf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.820223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c13a05145614943b0143184c5869faf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.821051 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 814/1621] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:56 2022] PUT /identity/v3/projects/31eed3c7098b4d5396a521bb89289f23/users/1c8bc9704cf94b5595b78c9091f05a09/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:56.823176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192615-9517-4f25-a7d1-1e2a942e3d5e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:56.824457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192615-9517-4f25-a7d1-1e2a942e3d5e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:56.825147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192615-9517-4f25-a7d1-1e2a942e3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:56.829931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c13a05145614943b0143184c5869faf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.846472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-32192615-9517-4f25-a7d1-1e2a942e3d5e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:56.847693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-32192615-9517-4f25-a7d1-1e2a942e3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:56.848013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c13a05145614943b0143184c5869faf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.862989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c13a05145614943b0143184c5869faf'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:56.873150 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 808/1622] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:56:56 2022] DELETE /identity/v3/users/2c13a05145614943b0143184c5869faf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:56.876902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:56.889635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.000060 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 815/1623] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:57.009204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.009497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.009747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.067528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:57.069137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.085085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33915862-b558-4b52-b4ab-b7e2c07a7238 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.104657 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 816/1624] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:57.111836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.113581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.114472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.114739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.115293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.120624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.122289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.138663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9e157-fecb-4725-b776-6d0b9ae99620 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.155291 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 809/1625] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:57.159092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.163856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.164551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.165217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.165217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.165898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:57.166195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.167828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.180516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d89578-d1bf-4373-8266-9f094d8ae963 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.194271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.196944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.197222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.197563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] PATH_INFO: `/v3/projects/31eed3c7098b4d5396a521bb89289f23/users/1c8bc9704cf94b5595b78c9091f05a09/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.200023 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 817/1626] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:57.209964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31eed3c7098b4d5396a521bb89289f23, user_id=1c8bc9704cf94b5595b78c9091f05a09, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.212800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd199c-c56b-408d-b584-63aaa23c74c2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.222237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.236169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1797c-68cb-49fa-aa5a-b15b5fcbe572 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.246246 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 810/1627] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:57 2022] PUT /identity/v3/projects/31eed3c7098b4d5396a521bb89289f23/users/1c8bc9704cf94b5595b78c9091f05a09/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:57.257203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.257509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.257835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.312145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:57.315455 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] MFA Rules not processed for user `1c8bc9704cf94b5595b78c9091f05a09`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:57.317348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.354284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.355706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.357851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.358098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.359410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.361425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.372689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:57.400023 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 818/1628] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:57.404398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.412890 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 811/1629] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:57.421848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.423231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.524450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55122c50-d3cf-4d8b-a4f5-72471589a10c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.531907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9846d66-bb04-48da-90d7-dedadd2492da admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.537601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.538235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.538510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.538780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.539422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.541488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.568451 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 819/1630] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:57.573276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.584925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e54cc-3c89-4be1-b961-35d568237afc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.590033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.590641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.590911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.591176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.591809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.593637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.605551 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 820/1631] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:57.608427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.609336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.609607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.609870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.610005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.623266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb996b-3eab-45c6-8b59-b9d9f690601d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.628633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.629516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.629966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.630440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.631221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.633176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.648346 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 821/1632] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:57.652439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.679093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c80f8-9b6a-4b9d-8084-d9a09bf1d848 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.690951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.691627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.691905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.692630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] PATH_INFO: `/v3/projects/2a85d17f51ef4853ae7630d371de8f33/users/2526509bb9cc4e29abf53713a0b176cb/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.694312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.695936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.706815 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 812/1633] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:57.708552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a85d17f51ef4853ae7630d371de8f33, user_id=2526509bb9cc4e29abf53713a0b176cb, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.711247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e91f50-9e27-4e15-9e50-41501e3dd487 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.746476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.748084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.753262 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 822/1634] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:57 2022] PUT /identity/v3/projects/2a85d17f51ef4853ae7630d371de8f33/users/2526509bb9cc4e29abf53713a0b176cb/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:57.772137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.773629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.774395 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.796196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159c0c1-e2e1-4047-b5cd-699c3eef86dc service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:57.864070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] MFA Rules not processed for user `2526509bb9cc4e29abf53713a0b176cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:57.865923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:57.879145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:57.895859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:57.896501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:57.896775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:57.897268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] PATH_INFO: `/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:57.898565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c9b7b26dbf4e0ea0298caa3ec32f4d)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:57.900942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:57.937576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:57.958747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c9b7b26dbf4e0ea0298caa3ec32f4d', 'request_id': 'req-565f13ed-a527-4e40-9bc2-304c65f078cd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:57.959859 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 823/1635] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:57.963470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.967460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c9b7b26dbf4e0ea0298caa3ec32f4d', 'request_id': 'req-565f13ed-a527-4e40-9bc2-304c65f078cd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:57.974678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c9b7b26dbf4e0ea0298caa3ec32f4d', 'request_id': 'req-565f13ed-a527-4e40-9bc2-304c65f078cd'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:57.988419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] The token cache is being invalidate because project c7c9b7b26dbf4e0ea0298caa3ec32f4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:56:57.988723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:57.989392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:56:57.990906 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 813/1636] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:56:57 2022] DELETE /identity/v3/projects/c7c9b7b26dbf4e0ea0298caa3ec32f4d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:57.994274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:57.994274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.019952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81abd-dc29-4657-82f7-777291c93810 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.055721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f13ed-a527-4e40-9bc2-304c65f078cd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.065321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.065884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.066154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.066423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.067051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.069455 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563eaa3a-b903-4c03-a5db-9cc9163499be admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.073244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.073925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.074264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.074706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.076758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.101164 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 814/1637] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:57 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:58.102596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ea42-3614-46fb-988f-b92394932703 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.102875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ea42-3614-46fb-988f-b92394932703 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.103142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ea42-3614-46fb-988f-b92394932703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.122249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-63d4ea42-3614-46fb-988f-b92394932703 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:58.123459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-63d4ea42-3614-46fb-988f-b92394932703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.162773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.164226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.175919 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 824/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:56:58.176746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.188673 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12150c5-8733-473c-921f-7d9288361d1b service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.189012 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 815/1639] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:58.193380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.194516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.194516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.194698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.195825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.197022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.197022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.197216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.197854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.206921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.220549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:58.222306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.225757 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 825/1640] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:58.227246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.237996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089941d-a8b1-492d-aaaa-abb757c6710a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.242458 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 816/1641] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:58.246273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.246273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.246273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.246273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.246583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.246804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.247398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.257654 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 826/1642] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:58.261499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.265790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81472bf0-eaf0-452c-a7ba-0e41671332a2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.273153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.273780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.274208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.274493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.274860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582ab90-c12f-4249-bc1f-5adcc505b1d6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.275765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:56:58.276071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.278842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.281251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.282930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.284850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.285318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.287189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.293235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.293966 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 817/1643] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:56:58.298921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.322928 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 827/1644] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:58.323612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923da5fc-6ad4-47b2-bfff-890913efa362 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.326905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.334877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.337469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.337748 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.338019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.340683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94970b-bd6e-41e3-8f89-d562bd77fdbc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.341049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.343055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.345696 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.346415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.346700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.346967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] PATH_INFO: `/v3/projects/e0e66c10b7bf47d8b7a909a97a945cfb/users/9e83999e1c564309baee3dfc3d6f473c/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.369909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e66c10b7bf47d8b7a909a97a945cfb, user_id=9e83999e1c564309baee3dfc3d6f473c, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.373348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124324a-6c40-4e10-ad00-5de873e5c666 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.378504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.388117 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 818/1645] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:58.392515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.397449 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 828/1646] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:58 2022] PUT /identity/v3/projects/e0e66c10b7bf47d8b7a909a97a945cfb/users/9e83999e1c564309baee3dfc3d6f473c/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:58.408415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.408710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.409083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.453099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] MFA Rules not processed for user `9e83999e1c564309baee3dfc3d6f473c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:58.454338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.494757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfe3a2-9ad5-46d8-b24a-434f9e41dba2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.534367 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 829/1647] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:58.538567 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.617830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.618680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.619057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.619446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.620384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.623654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.673944 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 819/1648] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:58.675115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.691193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207958af-3ea2-4a66-b41b-e7acaac1e3c8 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.692993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6acbc-f40b-444b-8979-e9c8483ea030 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.696218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.697266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.697790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.698197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.698970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.699650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.699761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.700044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.700379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.701121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.701734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.703090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.718577 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 820/1649] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:58.720228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.731646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93339be5-00af-4023-9b12-fd04d4bf34fd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.736609 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 830/1650] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:58.736735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.737257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.737586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.737866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.738493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.740234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.740389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.751595 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 821/1651] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:58.757472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.768147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596947e3-5409-4445-ac64-f1250b04bba4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.809998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.825431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e32a5f-8a17-4779-b536-8e6b4dbc2ea0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.830983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.831595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.831866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.832158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.832755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.834708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.836793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.837612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.837950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.838288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] PATH_INFO: `/v3/projects/8c15cc68248a458b9815a6a4dbc0de50/users/6272be9652e343729dbac16e377c4350/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.853618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:58.855000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c15cc68248a458b9815a6a4dbc0de50, user_id=6272be9652e343729dbac16e377c4350, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.858072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd640-0d9f-47d9-a344-299bca45f652 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.864129 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 831/1652] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:58.865135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.875019 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 822/1653] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:58 2022] PUT /identity/v3/projects/8c15cc68248a458b9815a6a4dbc0de50/users/6272be9652e343729dbac16e377c4350/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:58.882002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf900ac3-dd7a-4eaf-848c-d0bac0f2d445 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.885691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.886049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.886388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.926735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] MFA Rules not processed for user `6272be9652e343729dbac16e377c4350`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:58.928094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:58.956684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.957351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.957627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.958036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:58.958685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:58.960500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:58.971674 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 832/1654] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:58.975795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:58.986894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb08166-9d16-474a-b795-d5d0a2baead3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:58.992182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:58.993460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:58.993734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:58.994204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] PATH_INFO: `/v3/projects/0bbefd26966840d3ab20babe242ac9f3/users/b59dd411e87749c6ac830aa418ce4350/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.006436 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 823/1655] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:59.011038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbefd26966840d3ab20babe242ac9f3, user_id=b59dd411e87749c6ac830aa418ce4350, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.011177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.013830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.029587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780d4df-0bb9-4b29-9b3a-0c7dec3bc3a9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.032092 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 833/1656] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:58 2022] PUT /identity/v3/projects/0bbefd26966840d3ab20babe242ac9f3/users/b59dd411e87749c6ac830aa418ce4350/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:59.036141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.111018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.111828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.112200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.112564 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.113379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.115675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.129622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bf83-3fa2-42c2-b30b-d1ebe6060cbe admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.136103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.136798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.137193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.137528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.138510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.140534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.155359 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 834/1657] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:59.161242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.161348 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 824/1658] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:56:59.162132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.175324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb41312-2a26-4b7f-ae53-e3448e79cf41 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.208470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:59.234060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce865444-7550-4106-a18e-71ba77f5d507 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.238814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.239426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.239603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.239721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.240393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.240524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.240524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.240677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.240876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] PATH_INFO: `/v3/projects/0bbefd26966840d3ab20babe242ac9f3/users/b59dd411e87749c6ac830aa418ce4350/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.242732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.242968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bbefd26966840d3ab20babe242ac9f3, user_id=b59dd411e87749c6ac830aa418ce4350, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.245872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69f073-c03c-4c74-89a9-ceee49ed6957 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.257029 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 835/1659] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:59 2022] PUT /identity/v3/projects/0bbefd26966840d3ab20babe242ac9f3/users/b59dd411e87749c6ac830aa418ce4350/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:59.264589 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 825/1660] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:56:59 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:56:59.268223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.268420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.268541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.268761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.275908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:59.279158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b3fa0-10f7-4040-8ace-265f82be83eb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.299825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] MFA Rules not processed for user `b59dd411e87749c6ac830aa418ce4350`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:59.301060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:59.339331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.339902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.340159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.340431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.341705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.343402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.353864 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 826/1661] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:56:59.358067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.368135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bcc31-acdd-4f40-81a7-d511588f4887 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.373012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.377107 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 836/1662] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:56:59.377236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.377236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.377236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] PATH_INFO: `/v3/projects/3809c2f6108e443aa7530f661c9d38dd/users/6c4f6e9feca64db9b79891c57ca03a01/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.385089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.386494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:59.389662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3809c2f6108e443aa7530f661c9d38dd, user_id=6c4f6e9feca64db9b79891c57ca03a01, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.392320 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.407221 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 827/1663] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:59 2022] PUT /identity/v3/projects/3809c2f6108e443aa7530f661c9d38dd/users/6c4f6e9feca64db9b79891c57ca03a01/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:56:59.411314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.445302 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e83b27-6dd3-4ba1-b6c0-2e8f2852f713 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.475790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1481415-f6c7-478a-a090-71343305af62 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.483654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.484469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.484909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.485729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.485954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.487990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.498687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.502926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.502926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.502926 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.503218 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 828/1664] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:56:59.504206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.515425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bae374-bbe9-48b0-8eb0-26d721d1aa3e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.522796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.523637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.524318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.524603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] PATH_INFO: `/v3/projects/3809c2f6108e443aa7530f661c9d38dd/users/6c4f6e9feca64db9b79891c57ca03a01/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.526939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3809c2f6108e443aa7530f661c9d38dd, user_id=6c4f6e9feca64db9b79891c57ca03a01, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.529737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14152f5f-0856-4108-b263-5ab2ca040f68 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.546682 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 829/1665] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:56:59 2022] PUT /identity/v3/projects/3809c2f6108e443aa7530f661c9d38dd/users/6c4f6e9feca64db9b79891c57ca03a01/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:56:59.562487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.562487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.562487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.579858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:59.585556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.586676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.592344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] MFA Rules not processed for user `6c4f6e9feca64db9b79891c57ca03a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:56:59.593552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:59.596932 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 837/1666] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:59.602806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:56:59.647048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.649193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:59.666293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cc2cc-9482-47e8-873b-063104ad4ffc service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.708210 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 830/1667] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:56:59.739141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:56:59.760217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.760866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.761177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.761443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.764406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:56:59.809214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01938b3-7181-4228-b9c3-cda0b050a0a3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:56:59.813297 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:56:59.814199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:56:59.814461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:56:59.814810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:56:59.829727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.829940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:56:59.831203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.833670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:56:59.840609 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 838/1668] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:56:59.845745 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 831/1669] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:56:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:00.435854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:00.444864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518db10e-567b-4530-98e6-c8e6bc17e4d6 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:00.450100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:00.451128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:00.451128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:00.451631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:00.519189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:00.520628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e9fd6-c73c-4204-aa66-b08540bd67ce service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:00.536153 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 839/1670] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:03.092676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.153986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d799d6-72d5-454c-b08a-fd46dcfa6e3e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.159034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.159650 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.159922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.160190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] PATH_INFO: `/v3/users/2526509bb9cc4e29abf53713a0b176cb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.161351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2526509bb9cc4e29abf53713a0b176cb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.163290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:03.214129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2526509bb9cc4e29abf53713a0b176cb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.214758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2526509bb9cc4e29abf53713a0b176cb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.217359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:03.223665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2526509bb9cc4e29abf53713a0b176cb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.237444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2526509bb9cc4e29abf53713a0b176cb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.244091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2526509bb9cc4e29abf53713a0b176cb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.250469 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 832/1671] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:03 2022] DELETE /identity/v3/users/2526509bb9cc4e29abf53713a0b176cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:03.255481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.255923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.256110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.272944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.274387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.277308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:03.278521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.322311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:03.341764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9e434-e9ae-4423-b8b0-7b764a9109e6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.344341 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 840/1672] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:03.348097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.348753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.349054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.349329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] PATH_INFO: `/v3/users/6272be9652e343729dbac16e377c4350` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.350570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6272be9652e343729dbac16e377c4350)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.352858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:03.355091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.356823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.405542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6272be9652e343729dbac16e377c4350'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.406273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6272be9652e343729dbac16e377c4350'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.415105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6272be9652e343729dbac16e377c4350'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.427521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed469c8d-4277-45c0-a5b8-43f9ffad5c65 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.429972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6272be9652e343729dbac16e377c4350'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.432546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.433534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.433807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.434102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.437363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6241dbcc-0ea7-40cc-98c4-2566795a95ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6272be9652e343729dbac16e377c4350'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:03.443494 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 833/1673] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:03 2022] DELETE /identity/v3/users/6272be9652e343729dbac16e377c4350 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:03.444904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.446721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:03.447850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.448129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.448404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.458877 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 841/1674] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:03.467531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:03.468727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.511186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:03.536990 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 834/1675] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:03.550151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.559509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d12473-c635-4121-9b64-590e4056b066 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.617048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.617668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.617965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.618214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.628219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.629988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:03.640788 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 842/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:03.867341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.869004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.896073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:03.897880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:03.901945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd57beb-379d-4a15-9192-00787fcb8361 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.920030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c94-5d41-41a3-81cd-01c98b0feacc service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:03.922543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.923539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.924074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.924525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] PATH_INFO: `/v3/users/e7ad3ba93b6941b1b1f2d4fb9cc7117e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.926781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ad3ba93b6941b1b1f2d4fb9cc7117e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.926928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:03.927759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:03.928084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:03.928362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] PATH_INFO: `/v3/projects/2a85d17f51ef4853ae7630d371de8f33` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:03.929793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:03.930152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a85d17f51ef4853ae7630d371de8f33)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:03.932691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.008470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a85d17f51ef4853ae7630d371de8f33', 'request_id': 'req-d8a5e79b-5138-4d8e-a598-62234737a1cf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.024045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ad3ba93b6941b1b1f2d4fb9cc7117e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.025154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ad3ba93b6941b1b1f2d4fb9cc7117e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.026753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a85d17f51ef4853ae7630d371de8f33', 'request_id': 'req-d8a5e79b-5138-4d8e-a598-62234737a1cf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.039965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a85d17f51ef4853ae7630d371de8f33', 'request_id': 'req-d8a5e79b-5138-4d8e-a598-62234737a1cf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.042270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ad3ba93b6941b1b1f2d4fb9cc7117e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.067842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ad3ba93b6941b1b1f2d4fb9cc7117e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.070547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] The token cache is being invalidate because project 2a85d17f51ef4853ae7630d371de8f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:04.071605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.073371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.080875 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 843/1677] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:03 2022] DELETE /identity/v3/projects/2a85d17f51ef4853ae7630d371de8f33 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:04.084409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-514a7bda-c5de-43b8-b823-737efaadcc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ad3ba93b6941b1b1f2d4fb9cc7117e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.097105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.097105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.103723 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 835/1678] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:03 2022] DELETE /identity/v3/users/e7ad3ba93b6941b1b1f2d4fb9cc7117e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:04.108762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.109082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.109462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.125603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:04.137694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:04.139017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.212093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5e79b-5138-4d8e-a598-62234737a1cf admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.218710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.219499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.219871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.220256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] PATH_INFO: `/v3/users/9e83999e1c564309baee3dfc3d6f473c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.221670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e83999e1c564309baee3dfc3d6f473c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.223997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.227411 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 836/1679] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:04.238750 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.240157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.326501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e83999e1c564309baee3dfc3d6f473c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.340637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e83999e1c564309baee3dfc3d6f473c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.357891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e83999e1c564309baee3dfc3d6f473c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.360681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce026e-f674-4858-a91a-0f4316279e63 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.365426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.366043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.366314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.366583 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.368248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e83999e1c564309baee3dfc3d6f473c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.369330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e83999e1c564309baee3dfc3d6f473c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.376694 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 844/1680] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:04 2022] DELETE /identity/v3/users/9e83999e1c564309baee3dfc3d6f473c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:04.377104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.378029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.378590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.380479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.392073 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 837/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:04.455412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04afcead-0b69-4828-abee-a26a4816eb7e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.460867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.461908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.461908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.461908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] PATH_INFO: `/v3/projects/8c15cc68248a458b9815a6a4dbc0de50` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.463563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c15cc68248a458b9815a6a4dbc0de50)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.465566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.530792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:04.545530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c15cc68248a458b9815a6a4dbc0de50', 'request_id': 'req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.552428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c15cc68248a458b9815a6a4dbc0de50', 'request_id': 'req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.562426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c15cc68248a458b9815a6a4dbc0de50', 'request_id': 'req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.581076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] The token cache is being invalidate because project 8c15cc68248a458b9815a6a4dbc0de50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:04.581467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.582537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.584476 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 845/1682] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:04 2022] DELETE /identity/v3/projects/8c15cc68248a458b9815a6a4dbc0de50 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:04.588628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.590542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.604331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:04.610535 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e86b-6421-4deb-8ffb-4743abcf7feb service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.685536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.686264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.686534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.686847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] PATH_INFO: `/v3/users/6c4f6e9feca64db9b79891c57ca03a01` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.688000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4f6e9feca64db9b79891c57ca03a01)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.690415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:04.760106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4f6e9feca64db9b79891c57ca03a01'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.761146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4f6e9feca64db9b79891c57ca03a01'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.773405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4f6e9feca64db9b79891c57ca03a01'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.788378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4f6e9feca64db9b79891c57ca03a01'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.796723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4f6e9feca64db9b79891c57ca03a01'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:04.805691 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 838/1683] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:04 2022] DELETE /identity/v3/users/6c4f6e9feca64db9b79891c57ca03a01 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:04.884973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:04.886453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:04.912590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e03d5-09b3-4feb-bc72-9b1eb3c4b166 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:04.991101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:04.991789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:04.992229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:04.992505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] PATH_INFO: `/v3/projects/917d783d602245ee907f0a472e3d5165` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:04.993978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=917d783d602245ee907f0a472e3d5165)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:04.996488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.070744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917d783d602245ee907f0a472e3d5165', 'request_id': 'req-6ebed226-82a1-4d61-b58d-ac61a408a5bf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.081489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917d783d602245ee907f0a472e3d5165', 'request_id': 'req-6ebed226-82a1-4d61-b58d-ac61a408a5bf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.117647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917d783d602245ee907f0a472e3d5165', 'request_id': 'req-6ebed226-82a1-4d61-b58d-ac61a408a5bf'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.134296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.135799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.155019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446f1c-826b-4d9e-9bf9-2837d13bcf41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.165927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] The token cache is being invalidate because project 917d783d602245ee907f0a472e3d5165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:05.166225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.166988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.169792 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 846/1684] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:04 2022] DELETE /identity/v3/projects/917d783d602245ee907f0a472e3d5165 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:05.174923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.176972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.285264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.286060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.286400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.286736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] PATH_INFO: `/v3/projects/e0e66c10b7bf47d8b7a909a97a945cfb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.288286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e66c10b7bf47d8b7a909a97a945cfb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.291258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.335181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.342014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed226-82a1-4d61-b58d-ac61a408a5bf admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.349416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.352078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.353357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.354028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.354548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] PATH_INFO: `/v3/users/1c8bc9704cf94b5595b78c9091f05a09` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.356504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8bc9704cf94b5595b78c9091f05a09)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.360624 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.411273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e66c10b7bf47d8b7a909a97a945cfb', 'request_id': 'req-e5ab5c3d-fb80-415d-b676-211b35c6f970'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.439852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e66c10b7bf47d8b7a909a97a945cfb', 'request_id': 'req-e5ab5c3d-fb80-415d-b676-211b35c6f970'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.452044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e66c10b7bf47d8b7a909a97a945cfb', 'request_id': 'req-e5ab5c3d-fb80-415d-b676-211b35c6f970'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.470506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8bc9704cf94b5595b78c9091f05a09'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.484252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] The token cache is being invalidate because project e0e66c10b7bf47d8b7a909a97a945cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:05.484536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.486008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.486248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8bc9704cf94b5595b78c9091f05a09'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.489894 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 839/1685] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:05 2022] DELETE /identity/v3/projects/e0e66c10b7bf47d8b7a909a97a945cfb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:05.493290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.496344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.522252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8bc9704cf94b5595b78c9091f05a09'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.532484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8bc9704cf94b5595b78c9091f05a09'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.533649 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8bc9704cf94b5595b78c9091f05a09'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.550758 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 847/1686] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:05 2022] DELETE /identity/v3/users/1c8bc9704cf94b5595b78c9091f05a09 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:05.551945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.553606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.633711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfeb9bb-2936-4b25-9e17-d12b4e7461ff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.640455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.641321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.641475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.641669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] PATH_INFO: `/v3/users/b59dd411e87749c6ac830aa418ce4350` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.643410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59dd411e87749c6ac830aa418ce4350)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.644783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.646224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab5c3d-fb80-415d-b676-211b35c6f970 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.655691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:05.656513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.656920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.657292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] PATH_INFO: `/v3/projects/3809c2f6108e443aa7530f661c9d38dd` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.658817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3809c2f6108e443aa7530f661c9d38dd)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:05.661127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:05.721600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59dd411e87749c6ac830aa418ce4350'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.730616 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3809c2f6108e443aa7530f661c9d38dd', 'request_id': 'req-5c6c78c3-b359-4f0b-b175-5c6845abe588'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.731531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59dd411e87749c6ac830aa418ce4350'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.737984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3809c2f6108e443aa7530f661c9d38dd', 'request_id': 'req-5c6c78c3-b359-4f0b-b175-5c6845abe588'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.744720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3809c2f6108e443aa7530f661c9d38dd', 'request_id': 'req-5c6c78c3-b359-4f0b-b175-5c6845abe588'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.751976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59dd411e87749c6ac830aa418ce4350'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.759959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] The token cache is being invalidate because project 3809c2f6108e443aa7530f661c9d38dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:05.760313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.760976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5c6c78c3-b359-4f0b-b175-5c6845abe588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.765857 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 840/1687] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:05 2022] DELETE /identity/v3/projects/3809c2f6108e443aa7530f661c9d38dd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:05.766149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.767584 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.767843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.768129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.769780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59dd411e87749c6ac830aa418ce4350'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.770429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f5157845-ab95-4302-bd39-565cc811dd91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59dd411e87749c6ac830aa418ce4350'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:05.780890 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 848/1688] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:05 2022] DELETE /identity/v3/users/b59dd411e87749c6ac830aa418ce4350 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:05.792319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:05.793603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.837766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:05.861072 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 841/1689] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:05.868713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:05.869066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:05.869382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:05.906020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:05.908523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:05.945214 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 849/1690] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:05.947345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:05.980446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542b1af-fd86-41ba-8495-111702c79aa4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:05.996010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.001718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.002100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.002348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.003017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:06.003329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.005022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.036345 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 842/1691] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:06.041554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.056218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60805d-df82-4c46-918b-1ae904fb58b9 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.065752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.069153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.069153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.069153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.069632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.070446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.072278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.072775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.094005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342910e-6149-4c74-8c64-a332b227102c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.101405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.103993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.104273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.104546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] PATH_INFO: `/v3/projects/31eed3c7098b4d5396a521bb89289f23` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.106024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31eed3c7098b4d5396a521bb89289f23)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.110296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.141823 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 850/1692] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:06.143785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.175526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31eed3c7098b4d5396a521bb89289f23', 'request_id': 'req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.182278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31eed3c7098b4d5396a521bb89289f23', 'request_id': 'req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.190618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31eed3c7098b4d5396a521bb89289f23', 'request_id': 'req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.209103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] The token cache is being invalidate because project 31eed3c7098b4d5396a521bb89289f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:06.209410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.210597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7b7d0998-ad25-4bf7-b565-94e64ed8d33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.212742 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 843/1693] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:06 2022] DELETE /identity/v3/projects/31eed3c7098b4d5396a521bb89289f23 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:06.217788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253c1d-b5f9-4a44-b7ec-f5b273a01046 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.218066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253c1d-b5f9-4a44-b7ec-f5b273a01046 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.218341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15253c1d-b5f9-4a44-b7ec-f5b273a01046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.245931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1652-51e6-437c-bdf3-668afd28d3b9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.247920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-15253c1d-b5f9-4a44-b7ec-f5b273a01046 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:06.249424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-15253c1d-b5f9-4a44-b7ec-f5b273a01046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.326356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.327056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.327253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.327572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.328169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.330434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.347361 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 844/1694] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:06.355972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.356272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.356528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.361626 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 851/1695] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:06.365814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.368394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.384252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f5dc-c6fb-41e4-8b50-bbb88d99c5e1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.402331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:06.403661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.404416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.404743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.405044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.405703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.407364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.414460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.426365 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 845/1696] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:06.427222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.440049 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 852/1697] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:06.440049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.442495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.479447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851a47e-931e-49e2-a4d1-b93b7c59af62 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.481667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964ac66-cf44-4780-b199-3df4dbee512d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.487824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.488531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.488811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.489106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] PATH_INFO: `/v3/projects/0bbefd26966840d3ab20babe242ac9f3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.490072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.490753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.491037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.491305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.491963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:06.492077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bbefd26966840d3ab20babe242ac9f3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.492311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.494009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.496244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.509980 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 853/1698] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:06.514973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.530013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fbc3a-628a-4028-92c4-99f70d2319d0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.537714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.538615 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.539178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.539674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.540622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.543702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.559403 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 854/1699] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:06.560321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.574471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce672fd1-6ce0-4d75-865c-5d474b7cd33b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.584560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.585232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.585508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.585776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.586428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.589061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.614853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:06.621853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bbefd26966840d3ab20babe242ac9f3', 'request_id': 'req-61c5cb74-aa69-4a1d-8f14-ecb024216919'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.625065 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 855/1700] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:06.626121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.631677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:06.633333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bbefd26966840d3ab20babe242ac9f3', 'request_id': 'req-61c5cb74-aa69-4a1d-8f14-ecb024216919'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.641230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bbefd26966840d3ab20babe242ac9f3', 'request_id': 'req-61c5cb74-aa69-4a1d-8f14-ecb024216919'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.655271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] The token cache is being invalidate because project 0bbefd26966840d3ab20babe242ac9f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:06.655692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.656574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:06.658565 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 846/1701] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:06 2022] DELETE /identity/v3/projects/0bbefd26966840d3ab20babe242ac9f3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:06.659210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.660524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.709751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0be84b-0a2a-4841-957b-a799a4a1169d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.715695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.716380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.716658 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.717040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] PATH_INFO: `/v3/projects/d62f29dc35264501bd37e6a9324a2e07/users/baa849409cc543fd86a224da9315a357/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.734433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62f29dc35264501bd37e6a9324a2e07, user_id=baa849409cc543fd86a224da9315a357, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.737168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195ab3d-68df-4a80-8183-2f4237dfe41e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.743501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5cb74-aa69-4a1d-8f14-ecb024216919 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.748440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.749096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.749387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.749623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.750244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.752029 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 856/1702] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:06 2022] PUT /identity/v3/projects/d62f29dc35264501bd37e6a9324a2e07/users/baa849409cc543fd86a224da9315a357/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:06.752926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ca6de-1fac-4bea-ae10-c775b5778e52 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.753371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.753664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.753917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.776202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:06.777785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.784012 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 847/1703] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:06.785323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f341-f1de-4ad8-95e7-90bca63f51b3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.785498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f341-f1de-4ad8-95e7-90bca63f51b3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.785764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72f341-f1de-4ad8-95e7-90bca63f51b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.818575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-5f72f341-f1de-4ad8-95e7-90bca63f51b3 None None] MFA Rules not processed for user `baa849409cc543fd86a224da9315a357`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:06.820201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5f72f341-f1de-4ad8-95e7-90bca63f51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.855102 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 857/1704] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:06.857716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.883031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516ce61-2242-49f6-95f2-2ef77773d74f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.889553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.890425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.890802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.891323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.892084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.894020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.906217 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 848/1705] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:06.907516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb33ff-953f-484a-b204-9013499df8ef None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.907934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb33ff-953f-484a-b204-9013499df8ef None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.908212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb33ff-953f-484a-b204-9013499df8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.911522 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 858/1706] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:06.912459 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.941197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f3983-f63c-43d7-830f-315b02b527bd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:06.941421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-affb33ff-953f-484a-b204-9013499df8ef None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:06.943200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-affb33ff-953f-484a-b204-9013499df8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.949653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:06.950295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:06.950655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:06.950848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:06.951544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:06.953168 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 849/1707] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:06.953582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:06.954036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb33ff-953f-484a-b204-9013499df8ef None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.955882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-affb33ff-953f-484a-b204-9013499df8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:06.974231 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 859/1708] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:06.978218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:06.995484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bbdae-142e-4871-8d1c-162d3ac9b5c3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.001868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.002950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.002950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.003146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.003963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:07.004267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.006622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.043168 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 860/1709] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:07.044132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.062282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:07.084443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54930-5bcb-44bf-83a5-d4f2a15d494b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.090775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.091572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.091880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.092166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] PATH_INFO: `/v3/projects/3d34720a7969418993003ed859bab8c2/users/f541ebab04cf45c78e51e78b4340faac/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.111876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d34720a7969418993003ed859bab8c2, user_id=f541ebab04cf45c78e51e78b4340faac, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.114683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.118130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb33ff-953f-484a-b204-9013499df8ef None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.125496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.126607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.127300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.127779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.141576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.143420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f230-6f59-46ff-af1a-ff6eeb634b36 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.147952 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 861/1710] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:07 2022] PUT /identity/v3/projects/3d34720a7969418993003ed859bab8c2/users/f541ebab04cf45c78e51e78b4340faac/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:07.156194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.167665 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 850/1711] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:07.173622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.174322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.174803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.223190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:07.228077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] MFA Rules not processed for user `f541ebab04cf45c78e51e78b4340faac`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:07.231166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.274933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e928683-f89d-4eed-808c-3970b7095b8a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.283368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.285127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.285514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.285805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.286542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.289563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.335109 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 862/1712] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:07.335964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.337779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.391922 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 851/1713] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:07.396521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.418276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848331-ff42-40b7-a51f-d42a90a17c94 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.500383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2e9d6-7f21-45c3-afe6-e4ee9c1aaf91 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.517645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.519024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.519488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.519895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] PATH_INFO: `/v3/users/baa849409cc543fd86a224da9315a357` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.521877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa849409cc543fd86a224da9315a357)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.524256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.528169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.529546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.529923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.530779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.531008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.534061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.558362 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 852/1714] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:07.563801 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.575978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c74b31-7210-40dd-a4f3-505de4ea34bb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.581286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.581979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.582359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.582670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.583377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.585598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.587487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa849409cc543fd86a224da9315a357'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:07.598476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa849409cc543fd86a224da9315a357'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:07.614046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa849409cc543fd86a224da9315a357'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:07.616901 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 853/1715] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:07.616901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.625333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa849409cc543fd86a224da9315a357'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:07.626309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa849409cc543fd86a224da9315a357'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:07.635503 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 863/1716] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:07 2022] DELETE /identity/v3/users/baa849409cc543fd86a224da9315a357 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:07.636621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.639461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.677133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:07.677488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:07.706848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2de8d-9145-42a5-9635-d10cd41a0cb6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.712013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.712679 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.713029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.713413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.714063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.715941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e74d9-34df-4b00-846a-497335f2f643 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.720068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ecfce-f1bb-4899-99b1-2a4d52c24a46 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.725402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.726319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.727058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.727496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.728338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.729309 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 854/1717] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:07.730592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.730877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.731144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.731797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.766755 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 864/1718] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:07.767664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:07.768065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.768963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.771160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.778143 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 855/1719] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:07.779288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.791743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6490188-9dd5-4cfb-b012-12c55d14df07 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.793279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d1af8-e570-4c0c-b1b1-e6f4cf2b9207 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.797039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.797664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.797935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.798204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.798843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.800469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.801105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.801852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.802192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.802677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.803445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.805723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.812591 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 865/1720] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:07.816714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.823346 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 856/1721] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:07.827505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.840675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04038-fc1e-40d8-ad7b-e5fcdac3e2ca admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.850811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950147-a6b2-4e53-8c81-e3bc86b40ca0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:07.854194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.855001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.855262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.855538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] PATH_INFO: `/v3/projects/1ed3d05e004247d5a65f98bec92a307c/users/0a8239d1e9d64dcf9cc220c01565d6fa/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.857150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:07.858058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:07.859199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:07.859659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] PATH_INFO: `/v3/projects/f6796f97d29f4887a7f32cfb285329f4/users/6b5885234e4e4e69b5c9e101ddf69c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:07.881136 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6796f97d29f4887a7f32cfb285329f4, user_id=6b5885234e4e4e69b5c9e101ddf69c33, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.883560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed3d05e004247d5a65f98bec92a307c, user_id=0a8239d1e9d64dcf9cc220c01565d6fa, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:07.885045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.886851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:07.919922 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 857/1722] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:07 2022] PUT /identity/v3/projects/f6796f97d29f4887a7f32cfb285329f4/users/6b5885234e4e4e69b5c9e101ddf69c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:07.922192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:07.924654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:07.936909 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 866/1723] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:07 2022] PUT /identity/v3/projects/1ed3d05e004247d5a65f98bec92a307c/users/0a8239d1e9d64dcf9cc220c01565d6fa/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:07.938130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.025307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881d92-650b-442c-a37b-cc8b06c85fe5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.066664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0f16-3b04-4448-98b6-ac26abe59018 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.072660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.074142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.074506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.074852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.075578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.077453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e859a-bef6-4da0-be05-59d296c708e6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.090193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.091085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.091829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.092262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.105215 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 867/1724] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:08.106628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.109081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.109780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.110040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.110381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.121425 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 858/1725] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:08.122247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.133795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e1a2d-6c23-49ed-849b-85b108eeaa13 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.144297 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.145219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.145557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.145894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] PATH_INFO: `/v3/projects/f6796f97d29f4887a7f32cfb285329f4/users/6b5885234e4e4e69b5c9e101ddf69c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.149314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6796f97d29f4887a7f32cfb285329f4, user_id=6b5885234e4e4e69b5c9e101ddf69c33, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.150753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] MFA Rules not processed for user `0a8239d1e9d64dcf9cc220c01565d6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:08.152695 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49331b6d-c1c2-4b7b-8892-afedacc1ccf9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.152865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.172702 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 859/1726] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:08 2022] PUT /identity/v3/projects/f6796f97d29f4887a7f32cfb285329f4/users/6b5885234e4e4e69b5c9e101ddf69c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:08.184400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.184638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.185155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.233006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] MFA Rules not processed for user `6b5885234e4e4e69b5c9e101ddf69c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:08.236104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.257877 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 868/1727] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:08.260098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.272111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f5658-c7f1-4058-85e9-ccde30eeed20 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.286678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:08.289720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:08.353921 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 860/1728] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:08.356158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.364684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.365254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.365538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.366329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.366445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.368279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.369615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.405658 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 869/1729] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:08.410083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.454921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacab1-a010-4ba3-b0f9-5cb43094d58d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.500247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedc610-ac01-4c7f-8690-3ba9d70f685f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.508589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.509301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.509537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.509807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.510520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.512675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.545064 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 870/1730] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:08.545064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.546575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.553489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.554473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.554941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.555396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.557608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.562919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8adda-277c-48b7-a6b7-dea3e1a0d47e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.568296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.569213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.569584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.570032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] PATH_INFO: `/v3/projects/d62f29dc35264501bd37e6a9324a2e07` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.571330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62f29dc35264501bd37e6a9324a2e07)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.573643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.625166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.626547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.635578 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 861/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:08.636480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.637411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62f29dc35264501bd37e6a9324a2e07', 'request_id': 'req-f86ac715-1fe5-48d1-b64b-e01654d064d4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:08.644422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62f29dc35264501bd37e6a9324a2e07', 'request_id': 'req-f86ac715-1fe5-48d1-b64b-e01654d064d4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:08.647128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cddfb-1867-4c04-8005-cb565405cc4c service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.654188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62f29dc35264501bd37e6a9324a2e07', 'request_id': 'req-f86ac715-1fe5-48d1-b64b-e01654d064d4'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:08.671918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] The token cache is being invalidate because project d62f29dc35264501bd37e6a9324a2e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:08.671918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:08.673115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-f86ac715-1fe5-48d1-b64b-e01654d064d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:08.675106 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 871/1732] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:08 2022] DELETE /identity/v3/projects/d62f29dc35264501bd37e6a9324a2e07 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:08.679635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e991c-1780-457a-b1f7-d8fdf300354e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.680294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e991c-1780-457a-b1f7-d8fdf300354e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.680294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e991c-1780-457a-b1f7-d8fdf300354e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.687816 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:08.715307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-508e991c-1780-457a-b1f7-d8fdf300354e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:08.716550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-508e991c-1780-457a-b1f7-d8fdf300354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.718404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.719089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.719370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.719661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.720383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.722384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.726984 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 872/1733] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:08.736518 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 862/1734] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:08.736687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.736687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.736687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.737583 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.739424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.752885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:08.757283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e218698-d37b-4f3c-acd6-62e0284b0e07 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.764096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.765479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.766712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.767153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] PATH_INFO: `/v3/projects/7338e1cda56c40ce9e8be63156cd7259/users/d878a35751a0465e9dab152c9903c8c9/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.772019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:08.774069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:08.784127 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 873/1735] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:08.789486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.790433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338e1cda56c40ce9e8be63156cd7259, user_id=d878a35751a0465e9dab152c9903c8c9, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.793917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.803423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c99d4-9101-428a-b001-57104f9e5829 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.814342 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 863/1736] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:08 2022] PUT /identity/v3/projects/7338e1cda56c40ce9e8be63156cd7259/users/d878a35751a0465e9dab152c9903c8c9/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:08.818239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.873286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.874194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.874676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.875044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.875863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:08.876196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.878379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.902743 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 874/1737] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:08.902949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b78bd-9df7-4a37-9c5a-f3f9d41a0894 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.904456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.911405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.912785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.913370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.913844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.914923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.916970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.921480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6abfcb-ecb5-4f54-a251-720d0f7df543 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.933510 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 864/1738] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:08.934736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:08.944963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.945686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.948222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a50df-0d95-41ad-8684-90e584ff54c8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:08.948947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.949362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.950195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.953712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.953850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:08.954610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.955108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.955483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] PATH_INFO: `/v3/projects/7338e1cda56c40ce9e8be63156cd7259/users/d878a35751a0465e9dab152c9903c8c9/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:08.958402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7338e1cda56c40ce9e8be63156cd7259, user_id=d878a35751a0465e9dab152c9903c8c9, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:08.961574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2d27f-8031-41b3-a56f-50985a6e456d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:08.978115 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 865/1739] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:08 2022] PUT /identity/v3/projects/7338e1cda56c40ce9e8be63156cd7259/users/d878a35751a0465e9dab152c9903c8c9/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:08.990089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:08.990527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:08.990917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.016040 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 875/1740] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:09.020230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.027608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] MFA Rules not processed for user `d878a35751a0465e9dab152c9903c8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:09.029284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:09.151596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e9039-1e65-4060-85e8-d14e01f5abb2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.165217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.165418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.169332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.169332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.169332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.169332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.201433 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 866/1741] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:09.215645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.216999 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 876/1742] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:09 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:09.217795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:09.217915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.244550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:09.245151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e8c17-ff63-485e-97e5-5aa1fb353390 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.256293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.256948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.257384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.257723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.258296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.260087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.278726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 877/1743] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:09.283768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.298224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290ad89-cd92-48fb-8d78-ed57ca41f973 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.304276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.305065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.305440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.305801 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.307338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.308767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe2ebb-a520-4af6-848c-c4157e30d45d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.309218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.314555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.315531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.315980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.316408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.330077 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 878/1744] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:09.330843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.333821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.335992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b933e-44de-46de-9865-46a0d5b98ec0 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.350280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89a1ef-ea24-497c-84c8-21c40edbea83 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.363638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.363638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.363638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.363638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] PATH_INFO: `/v3/projects/287db319ab58466da29ab194275b14b6/users/f6ed55e25c0d4b62bb01b8e8c5fae673/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.371742 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 867/1745] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:09.377968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287db319ab58466da29ab194275b14b6, user_id=f6ed55e25c0d4b62bb01b8e8c5fae673, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.381040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.400092 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 879/1746] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:09 2022] PUT /identity/v3/projects/287db319ab58466da29ab194275b14b6/users/f6ed55e25c0d4b62bb01b8e8c5fae673/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:09.410578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.410935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.411213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.441437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] MFA Rules not processed for user `f6ed55e25c0d4b62bb01b8e8c5fae673`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:09.442660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:09.599781 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 868/1747] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:09.604881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.633792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:09.764488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b7e1-0454-4822-87e1-f3ea55ba5ae2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.779958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.780592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.780882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.781148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.781798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.783703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:09.850311 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 880/1748] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:09 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:09.855009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:09.874612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b43b8-74de-4022-afdc-d3e0be003be2 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:09.972364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:09.973106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:09.973538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:09.973787 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:09.974520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:09.977117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.000870 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 869/1749] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:09 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:10.003814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.014537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528913-38e1-48eb-bbc3-9180a33b6cb6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.019394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.020005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.020398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.020543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.021223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.022811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.042957 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 881/1750] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:10.046848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.060383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3572d2-6634-4868-acc0-5e31185e08cc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.066191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.067075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.067075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.067344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.067973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.069756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8609343-e50a-4ad9-96e3-c5435369b466 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.082719 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 870/1751] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:10.086600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.101024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578672-7f51-4896-94c9-e571c473a9fc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.108554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.110039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.110421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.111459 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] PATH_INFO: `/v3/projects/1001f3817eb04401b1b5d0b135c56ed0/users/5f746053c44942e585d9cc0b77b20af9/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.138815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1001f3817eb04401b1b5d0b135c56ed0, user_id=5f746053c44942e585d9cc0b77b20af9, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.142894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.167517 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 882/1752] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:10 2022] PUT /identity/v3/projects/1001f3817eb04401b1b5d0b135c56ed0/users/5f746053c44942e585d9cc0b77b20af9/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:10.179958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.180242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.180518 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.243762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] MFA Rules not processed for user `5f746053c44942e585d9cc0b77b20af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:10.245197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:10.304217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:10.346205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.415415 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 871/1753] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:10.420123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.468067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804738a6-dd0c-43e9-9ed7-b638d99af6c6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.483295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.484062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.484413 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.484808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] PATH_INFO: `/v3/users/0a8239d1e9d64dcf9cc220c01565d6fa` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.493688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8239d1e9d64dcf9cc220c01565d6fa)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.495770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.521844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228118-288d-4796-b34c-d149cf3b32bc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.529950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.530731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.531072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.531425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.532142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.535435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.587115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8239d1e9d64dcf9cc220c01565d6fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:10.590022 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 872/1754] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:10 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:10.591065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.605298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8239d1e9d64dcf9cc220c01565d6fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:10.627458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:10.637254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8239d1e9d64dcf9cc220c01565d6fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:10.661028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8239d1e9d64dcf9cc220c01565d6fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:10.662236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5792e4b5-1fcc-4dd7-a647-9ad55db72957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8239d1e9d64dcf9cc220c01565d6fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:10.689769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab535c27-a2d0-4efb-b2ad-932398c90a8c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.695450 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 883/1755] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:10 2022] DELETE /identity/v3/users/0a8239d1e9d64dcf9cc220c01565d6fa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:10.701017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.701396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.701675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.721489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.722720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.722720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.722996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.723641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.723973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:10.725642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:10.725785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.771674 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 873/1756] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:10 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:10.777823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.787041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:10.802228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b55906-504a-416b-99f2-237e4c4e12b3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.837001 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 884/1757] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:10.845093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:10.849108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.850960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:10.880526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.881462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.881758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.882002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.882643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.884252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.894820 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 874/1758] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:10.902043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.923150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de037f1-aec4-423c-b200-b75d8a9eda80 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.930485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.931222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.931496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.931774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] PATH_INFO: `/v3/projects/d433223202b34aae91afe77e5a19fbcc/users/be9e2309fea640a489d76421fe1d0574/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.936139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebe54c-5683-46fe-ae4a-db4b6e9d8c3d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:10.941475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:10.942012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:10.942289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:10.942873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:10.950238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d433223202b34aae91afe77e5a19fbcc, user_id=be9e2309fea640a489d76421fe1d0574, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.954397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:10.954562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.955839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:10.977991 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 875/1759] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:10 2022] PUT /identity/v3/projects/d433223202b34aae91afe77e5a19fbcc/users/be9e2309fea640a489d76421fe1d0574/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:10.979293 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:10.981586 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 885/1760] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:11.053540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caa404-3c84-47d9-b266-4cc596ab64f9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:11.068818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:11.069746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.070121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.070872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.071713 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:11.073510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759e87-94e2-46e5-ae59-cbd711f84427 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:11.092932 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 876/1761] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:11.097095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:11.108326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2138c0-766d-422a-84be-d13ce202a702 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:11.113243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:11.113917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.114192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.114461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] PATH_INFO: `/v3/projects/d433223202b34aae91afe77e5a19fbcc/users/be9e2309fea640a489d76421fe1d0574/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.116823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d433223202b34aae91afe77e5a19fbcc, user_id=be9e2309fea640a489d76421fe1d0574, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:11.119656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:11.132389 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 886/1762] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:11 2022] PUT /identity/v3/projects/d433223202b34aae91afe77e5a19fbcc/users/be9e2309fea640a489d76421fe1d0574/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:11.145224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.145521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.145792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.181505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] MFA Rules not processed for user `be9e2309fea640a489d76421fe1d0574`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:11.183133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:11.252148 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 877/1763] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:11.264489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:11.266424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:11.290153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:11.291725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:11.328423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:11.337108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7910f-8925-4d24-a838-025123096582 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:11.340710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:11.341361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.341705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.341974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.344052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:11.367843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64018282-caff-4932-8ef5-e2ec2a9ebaa7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:11.372337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:11.372979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:11.373093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.373301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.373578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] PATH_INFO: `/v3/projects/1ed3d05e004247d5a65f98bec92a307c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.374706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed3d05e004247d5a65f98bec92a307c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:11.376627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:11.409124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:11.410698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:11.419890 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 887/1764] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:11.426281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed3d05e004247d5a65f98bec92a307c', 'request_id': 'req-a88eff15-0c74-421e-b2af-7144612ab636'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.431988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed3d05e004247d5a65f98bec92a307c', 'request_id': 'req-a88eff15-0c74-421e-b2af-7144612ab636'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.439759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed3d05e004247d5a65f98bec92a307c', 'request_id': 'req-a88eff15-0c74-421e-b2af-7144612ab636'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.455421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] The token cache is being invalidate because project 1ed3d05e004247d5a65f98bec92a307c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:11.455703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.456343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.458240 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 878/1765] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:11 2022] DELETE /identity/v3/projects/1ed3d05e004247d5a65f98bec92a307c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:11.462201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:11.473640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5649ecc-5c51-4069-b069-57b2046c68b0 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:11.531881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:11.532633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:11.533099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:11.533378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] PATH_INFO: `/v3/users/d878a35751a0465e9dab152c9903c8c9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:11.534520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d878a35751a0465e9dab152c9903c8c9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:11.536776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:11.585725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd878a35751a0465e9dab152c9903c8c9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.593478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd878a35751a0465e9dab152c9903c8c9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.606502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd878a35751a0465e9dab152c9903c8c9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.613824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd878a35751a0465e9dab152c9903c8c9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.614493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1eb712b5-19b2-4f06-99eb-f78eec4b7c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd878a35751a0465e9dab152c9903c8c9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:11.620742 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 888/1766] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:11 2022] DELETE /identity/v3/users/d878a35751a0465e9dab152c9903c8c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:12.072813 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.074571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.097030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88eff15-0c74-421e-b2af-7144612ab636 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.158978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.159707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.160185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.160424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] PATH_INFO: `/v3/projects/7338e1cda56c40ce9e8be63156cd7259` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.161646 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7338e1cda56c40ce9e8be63156cd7259)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.163724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.238488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7338e1cda56c40ce9e8be63156cd7259', 'request_id': 'req-8ea49831-854b-4d7b-be30-cccb39941c84'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:12.244549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7338e1cda56c40ce9e8be63156cd7259', 'request_id': 'req-8ea49831-854b-4d7b-be30-cccb39941c84'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:12.245758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:12.253360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7338e1cda56c40ce9e8be63156cd7259', 'request_id': 'req-8ea49831-854b-4d7b-be30-cccb39941c84'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:12.267687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] The token cache is being invalidate because project 7338e1cda56c40ce9e8be63156cd7259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:12.268010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:12.268645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8ea49831-854b-4d7b-be30-cccb39941c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:12.270667 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 879/1767] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:12 2022] DELETE /identity/v3/projects/7338e1cda56c40ce9e8be63156cd7259 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:12.275715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.276003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.276274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.296720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:12.298000 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.344073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:12.364090 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 889/1768] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:12.372166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.372502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.372916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.394612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:12.396318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.404236 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 880/1769] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:12.408529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.419258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b5948-0d88-486f-822d-2da1f5e5e01d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.424828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.425490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.425766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.427412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.428234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:12.428540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.433929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.452043 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 890/1770] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:12.456549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.465673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7a70d-9f09-4eee-8bff-81807413572f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.470287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.470878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.471150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.471410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.472031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.473977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.505567 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 881/1771] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:12 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:12.510572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.522322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad79af-1b72-4e4d-8ca9-3c850b8bc16e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.585690 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.586312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.586589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.586855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.587495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.589474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.619651 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 891/1772] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:12 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:12.621117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.631616 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce211-7f61-4966-9d56-abde6a12e245 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.636098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.636694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.637001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.637267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.637906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.639510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.650162 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 882/1773] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:12.654482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.664874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9264b32-e3b3-4e00-9cf9-43afe9c16501 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.671092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.671979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.672261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.672522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.673208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.674884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e069b-52d6-4766-b5b5-8a235cb44002 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.687698 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 892/1774] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:12.692090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.703137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b8ef-e30d-4c0a-8492-c883260ff2fa admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.708205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.708884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.709170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.709440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] PATH_INFO: `/v3/projects/77a4b949797d4830813f06945fed1d58/users/380ff39891dc4709b2d8a1ad2cf5759e/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.724502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a4b949797d4830813f06945fed1d58, user_id=380ff39891dc4709b2d8a1ad2cf5759e, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.727574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.741130 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 883/1775] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:12 2022] PUT /identity/v3/projects/77a4b949797d4830813f06945fed1d58/users/380ff39891dc4709b2d8a1ad2cf5759e/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:12.752488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.752765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.753079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.781716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] MFA Rules not processed for user `380ff39891dc4709b2d8a1ad2cf5759e`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:12.783010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.862177 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 893/1776] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:12.898480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.900267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.959552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:12.960950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.961497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04673f-5000-48e1-ae12-5e2fa3107b11 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.965120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.965732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.966092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.966367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.973661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26f227-d0f3-434b-a1b5-4bbd3e358871 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:12.978357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:12.978663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:12.979278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:12.979568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:12.979816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:12.980404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:12.981865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:12.992819 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 884/1777] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:13.009330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:13.032948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:13.055610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:13.070336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f293770-8182-489e-9bc7-4a9bbf18043d service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:13.086493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db01e-701a-4baf-804b-ea90cb724800 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:13.088729 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 894/1778] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:13.094910 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:13.096450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:13.096897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:13.097321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] PATH_INFO: `/v3/users/380ff39891dc4709b2d8a1ad2cf5759e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:13.099140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380ff39891dc4709b2d8a1ad2cf5759e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:13.102166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:13.158959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:13.211448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380ff39891dc4709b2d8a1ad2cf5759e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:13.212338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380ff39891dc4709b2d8a1ad2cf5759e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:13.234211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380ff39891dc4709b2d8a1ad2cf5759e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:13.264936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380ff39891dc4709b2d8a1ad2cf5759e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:13.290533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380ff39891dc4709b2d8a1ad2cf5759e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:13.313639 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 885/1779] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:13 2022] DELETE /identity/v3/users/380ff39891dc4709b2d8a1ad2cf5759e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:13.318186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:13.318589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:13.318934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:13.365949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:13.367254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:13.400335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:13.402326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:13.509069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccdb43-5127-4bc2-9064-b8f0374b7565 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:13.516791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:13.517460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:13.518879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:13.519177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:13.524649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:13.542469 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 895/1780] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:13.555601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:13.557556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:13.673317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:13.674776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:13.681200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3868a6-03bc-4c23-a964-77220909de4b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:13.689132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:13.690164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:13.695997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:13.702977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:13.712680 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 886/1781] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:13.730388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:13.731911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:13.746315 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 896/1782] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:14.149803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:14.151392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:14.166330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd39-d110-441d-af97-8e4af5d84913 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:14.177447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:14.178351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:14.178786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:14.179262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:14.189268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:14.322316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:14.351427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:14.353882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140c5c9-5d4a-4047-948e-3cdf047154bd service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:14.369405 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 887/1783] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:14.568802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:14.570650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:14.586357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cea96-2701-4a3a-9678-19fc695924f7 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:14.591727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:14.592113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:14.592382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:14.592644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] PATH_INFO: `/v3/projects/77a4b949797d4830813f06945fed1d58` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:14.594051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a4b949797d4830813f06945fed1d58)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:14.596092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:14.681290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a4b949797d4830813f06945fed1d58', 'request_id': 'req-51237ae5-701c-4d82-8bc2-b3169e126bf7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:14.707961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a4b949797d4830813f06945fed1d58', 'request_id': 'req-51237ae5-701c-4d82-8bc2-b3169e126bf7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:14.726819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a4b949797d4830813f06945fed1d58', 'request_id': 'req-51237ae5-701c-4d82-8bc2-b3169e126bf7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:14.743758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] The token cache is being invalidate because project 77a4b949797d4830813f06945fed1d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:14.744562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:14.745558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-51237ae5-701c-4d82-8bc2-b3169e126bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:14.749582 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 897/1784] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:14 2022] DELETE /identity/v3/projects/77a4b949797d4830813f06945fed1d58 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:14.752614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:14.752921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:14.753192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:14.773951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:14.775166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:14.875900 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 888/1785] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:14.886085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:14.886085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:14.886481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:14.910026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:14.918026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:14.919915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:14.930776 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 898/1786] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:14.935033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:14.946667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440b33e-d429-4a86-b917-580c66dd538d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:14.952805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:14.953670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:14.954059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:14.954381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:14.955209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:14.955568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:14.957595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:14.988113 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 889/1787] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:14.992215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.005245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a53d8-693e-488a-9c00-c05dd7ec9836 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.018560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.019553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.019906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.020245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.020998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.022982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.054348 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 899/1788] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:14 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:15.058454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.070882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe5aa5-f477-427f-a074-b536533fd0f0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.145688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.146909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.147273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.147617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.148426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.150560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.174625 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 890/1789] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:15 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:15.179114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.199933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87325a-2788-48be-874d-48496873e5da admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.206212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.206935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.207282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.207750 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.208490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.210227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.220980 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 900/1790] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:15.224974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.236311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7d2fc-16af-4a23-8bbe-9bc86506e915 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.241883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.242477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.242944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.243467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.244271 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.246213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee973a-5841-4e02-a79b-bdede2265565 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.258724 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 891/1791] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:15.263091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.273457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae55a86-89de-42ff-9734-c1ee9ad551a0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.278619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.279351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.279627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.279902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] PATH_INFO: `/v3/projects/3cbdd121edf94af7a1cd6f66eb9c0e42/users/8f0ea9a6bc2e4606b3a6041ab727bbe9/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.295204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbdd121edf94af7a1cd6f66eb9c0e42, user_id=8f0ea9a6bc2e4606b3a6041ab727bbe9, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.298634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.315404 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 901/1792] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:15 2022] PUT /identity/v3/projects/3cbdd121edf94af7a1cd6f66eb9c0e42/users/8f0ea9a6bc2e4606b3a6041ab727bbe9/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:15.326692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.327199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.327199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.387430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] MFA Rules not processed for user `8f0ea9a6bc2e4606b3a6041ab727bbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:15.387430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:15.439778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:15.468669 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 892/1793] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:15.473350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.560697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbb6f4-78e2-498f-a290-5f4da599700c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.566214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.566877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.567145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.567412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.568088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.574426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.608790 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 902/1794] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:15 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:15.613394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.635668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297dbb0-30de-4570-b235-74042f891e68 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.760358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.761261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.761874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.762863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.763828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.766863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.793208 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 893/1795] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:15 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:15.797827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.810526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc1468-924b-42ab-8f0c-00237abdc228 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.816551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.817232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.817762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.819537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.821877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.824537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.839506 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 903/1796] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:15.844526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.855730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230f74a-5802-4357-8abb-f917428e8f92 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.861529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.862323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.862666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.863101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:15.864058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:15.865987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29e7f3-5dd5-41d1-834a-8e93839ffc34 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:15.879238 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 894/1797] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:15.899509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:15.934216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfdffc-81a3-4de8-a78a-2880cfc9ad11 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:15.946010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:15.949508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:15.950116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:15.964242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] PATH_INFO: `/v3/projects/2b40d83d4c04419284aaaacad1c60f51/users/fa5a65771e96496fb749c02f30707c79/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.033401 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b40d83d4c04419284aaaacad1c60f51, user_id=fa5a65771e96496fb749c02f30707c79, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.036461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.056387 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 904/1798] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:15 2022] PUT /identity/v3/projects/2b40d83d4c04419284aaaacad1c60f51/users/fa5a65771e96496fb749c02f30707c79/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:16.068595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.069004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.069876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.113357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] MFA Rules not processed for user `fa5a65771e96496fb749c02f30707c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:16.115270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:16.216770 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 895/1799] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:16.222020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.319693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:16.342036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050e341-7294-4984-8465-d1ec22def3f6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.361303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.361938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.362215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.362481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.363126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.365834 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.431619 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 905/1800] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:16 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:16.435901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.462796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86387d11-82f3-47c1-bf14-e4d9306ad032 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.571399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:16.615253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.615794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.616221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.616571 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.617291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.619434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.647699 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 896/1801] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:16 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:16.651956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.665675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03c916-0981-452a-aa35-21875ecfec30 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.673489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.674477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.675123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.675579 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.676372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.678814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.693571 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 906/1802] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:16.697988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.716167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b10c5-630d-42fc-bd1a-4cf299226143 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.721785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.722516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.722867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.723204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] PATH_INFO: `/v3/projects/94577750ea4f4ff89a6a9506950debcf/users/c4d60ef4846a4b10ae903fe0b027224d/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.741368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94577750ea4f4ff89a6a9506950debcf, user_id=c4d60ef4846a4b10ae903fe0b027224d, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.744960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.763802 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 897/1803] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:16 2022] PUT /identity/v3/projects/94577750ea4f4ff89a6a9506950debcf/users/c4d60ef4846a4b10ae903fe0b027224d/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:16.767563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.778201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1758172-6a15-4e80-a708-0a1b903f0467 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.860031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.861141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.861540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.861902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.862639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.865207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9184259-2029-49c2-bb30-4439632c5b1c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.875263 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 907/1804] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:16.879780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:16.891550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b8de-00bc-43aa-b8f6-b977938e6111 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:16.897795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:16.898671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.899057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.899403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] PATH_INFO: `/v3/projects/94577750ea4f4ff89a6a9506950debcf/users/c4d60ef4846a4b10ae903fe0b027224d/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.901631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94577750ea4f4ff89a6a9506950debcf, user_id=c4d60ef4846a4b10ae903fe0b027224d, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:16.904587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:16.916423 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 898/1805] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:16 2022] PUT /identity/v3/projects/94577750ea4f4ff89a6a9506950debcf/users/c4d60ef4846a4b10ae903fe0b027224d/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:16.927282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:16.927569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:16.927831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:16.957387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] MFA Rules not processed for user `c4d60ef4846a4b10ae903fe0b027224d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:16.958980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:17.039897 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 908/1806] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:17.055148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:17.059582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:17.182145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acf7ac-a28a-4756-8529-61b0d883af58 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:17.190776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:17.191412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:17.191690 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:17.191956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:17.277781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:17.279290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7c5e-bf97-4fb1-aaf6-f7ee0557f044 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:17.289926 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 899/1807] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:18.734816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:18.736356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:18.788453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:18.806330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767e52e-a1fa-47ad-b5a0-8a39f392cf3a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:18.811331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:18.812098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:18.812564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:18.812998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] PATH_INFO: `/v3/users/f6ed55e25c0d4b62bb01b8e8c5fae673` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:18.814117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ed55e25c0d4b62bb01b8e8c5fae673)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:18.816313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:18.893014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ed55e25c0d4b62bb01b8e8c5fae673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:18.905881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ed55e25c0d4b62bb01b8e8c5fae673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:18.927702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ed55e25c0d4b62bb01b8e8c5fae673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:18.937581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ed55e25c0d4b62bb01b8e8c5fae673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:18.938477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ed55e25c0d4b62bb01b8e8c5fae673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:18.949879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:18.950359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:18.950612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:18.953871 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 909/1808] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:18 2022] DELETE /identity/v3/users/f6ed55e25c0d4b62bb01b8e8c5fae673 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:18.961242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:18.961242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:18.983963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:18.985482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.059449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974e6e7-7417-40ae-97a8-42019658ed37 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.063003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:19.067086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.067849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.068131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.068883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.071216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.081588 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 900/1809] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:19.081588 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.081832 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.100145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a1782-e000-4a4b-ac00-c39d765442a1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.105702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.106371 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.107071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.107071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] PATH_INFO: `/v3/users/f541ebab04cf45c78e51e78b4340faac` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.108124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f541ebab04cf45c78e51e78b4340faac)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.110169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.162701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.165435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.171603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f541ebab04cf45c78e51e78b4340faac'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:19.172331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f541ebab04cf45c78e51e78b4340faac'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:19.181315 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 910/1810] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:19.184439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f541ebab04cf45c78e51e78b4340faac'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:19.184758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.187652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.213026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f541ebab04cf45c78e51e78b4340faac'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:19.222424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f0fda9bb-6f8d-459b-a3cb-13e3221a35e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f541ebab04cf45c78e51e78b4340faac'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:19.239972 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 901/1811] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:19 2022] DELETE /identity/v3/users/f541ebab04cf45c78e51e78b4340faac => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:19.245404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.245687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.246009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:19.247032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.275941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:19.277880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.290868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af9993-823c-4d42-843c-ce5edd99ce53 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.352823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.353734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.354014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.354285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.356234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.359182 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 902/1812] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:19.370456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.373329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.375273 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.377182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.389238 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 911/1813] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:19.391412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4697824-2c33-4456-b675-c0bb65a487bc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.400989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.401624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.401904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.402183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.414065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.415884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.428288 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 903/1814] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:19.888684 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.890602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.931957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:19.933557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:19.971757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6a458-17b9-4760-a4e5-856ab712be18 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.985255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.988538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:19.988825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:19.989140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] PATH_INFO: `/v3/projects/287db319ab58466da29ab194275b14b6` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:19.990338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287db319ab58466da29ab194275b14b6)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:19.992303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:19.995497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0a1a7-8845-4be7-9109-2212407bfc28 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:19.999387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:19.999995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.000264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.000924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.002406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.050834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287db319ab58466da29ab194275b14b6', 'request_id': 'req-77c55c2b-38e5-440e-a352-6eebf6bfc294'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.056291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:20.059138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287db319ab58466da29ab194275b14b6', 'request_id': 'req-77c55c2b-38e5-440e-a352-6eebf6bfc294'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.072830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287db319ab58466da29ab194275b14b6', 'request_id': 'req-77c55c2b-38e5-440e-a352-6eebf6bfc294'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.100028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:20.102163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:20.106131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] The token cache is being invalidate because project 287db319ab58466da29ab194275b14b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:20.107028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.107342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.109411 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 904/1815] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:19 2022] DELETE /identity/v3/projects/287db319ab58466da29ab194275b14b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:20.113112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:20.114998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.121477 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 912/1816] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:20.171230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:20.173104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.192610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55803f-d3d8-44cc-a065-2c5c94d61b6f service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:20.289498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:20.292559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c55c2b-38e5-440e-a352-6eebf6bfc294 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:20.299954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:20.300631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.300940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.301335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] PATH_INFO: `/v3/users/5f746053c44942e585d9cc0b77b20af9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.302921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f746053c44942e585d9cc0b77b20af9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:20.305273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:20.331075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:20.333091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.333618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.334076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] PATH_INFO: `/v3/projects/3d34720a7969418993003ed859bab8c2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.335784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d34720a7969418993003ed859bab8c2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:20.339707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:20.378517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f746053c44942e585d9cc0b77b20af9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.379323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f746053c44942e585d9cc0b77b20af9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.392866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f746053c44942e585d9cc0b77b20af9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.417154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f746053c44942e585d9cc0b77b20af9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.418165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d34720a7969418993003ed859bab8c2', 'request_id': 'req-8a48e64a-5bef-494d-863b-7da00a07c7d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.425612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f746053c44942e585d9cc0b77b20af9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.426613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d34720a7969418993003ed859bab8c2', 'request_id': 'req-8a48e64a-5bef-494d-863b-7da00a07c7d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.434934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d34720a7969418993003ed859bab8c2', 'request_id': 'req-8a48e64a-5bef-494d-863b-7da00a07c7d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.437876 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 905/1817] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:20 2022] DELETE /identity/v3/users/5f746053c44942e585d9cc0b77b20af9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:20.451920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] The token cache is being invalidate because project 3d34720a7969418993003ed859bab8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:20.452249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.453153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.456691 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 913/1818] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:20 2022] DELETE /identity/v3/projects/3d34720a7969418993003ed859bab8c2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:20.461337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:20.463639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:20.558923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f72e86-5fa2-4751-80eb-6aaf4ec7bf2f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:20.566164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:20.566933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:20.567212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:20.567513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] PATH_INFO: `/v3/users/6b5885234e4e4e69b5c9e101ddf69c33` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:20.568994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5885234e4e4e69b5c9e101ddf69c33)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:20.571890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:20.575542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:20.670027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5885234e4e4e69b5c9e101ddf69c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.670737 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5885234e4e4e69b5c9e101ddf69c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.699687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5885234e4e4e69b5c9e101ddf69c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.717591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5885234e4e4e69b5c9e101ddf69c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.731514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5885234e4e4e69b5c9e101ddf69c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:20.745297 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 906/1819] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:20 2022] DELETE /identity/v3/users/6b5885234e4e4e69b5c9e101ddf69c33 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:21.105389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.107184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.138719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.142391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.178969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48e64a-5bef-494d-863b-7da00a07c7d3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.265433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b925-9ba4-45dc-8503-b08df6745c05 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.269156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.270615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.270893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.271313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.271608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.271925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] PATH_INFO: `/v3/projects/f6796f97d29f4887a7f32cfb285329f4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.272374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.272853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] PATH_INFO: `/v3/projects/1001f3817eb04401b1b5d0b135c56ed0` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.273549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6796f97d29f4887a7f32cfb285329f4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.274190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1001f3817eb04401b1b5d0b135c56ed0)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.276637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.276882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.310018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:21.345668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1001f3817eb04401b1b5d0b135c56ed0', 'request_id': 'req-89765d9b-33f6-485c-a094-b8bd1575ca8b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.353696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1001f3817eb04401b1b5d0b135c56ed0', 'request_id': 'req-89765d9b-33f6-485c-a094-b8bd1575ca8b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.362024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1001f3817eb04401b1b5d0b135c56ed0', 'request_id': 'req-89765d9b-33f6-485c-a094-b8bd1575ca8b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.381160 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] The token cache is being invalidate because project 1001f3817eb04401b1b5d0b135c56ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:21.381493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.382280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.387807 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 907/1820] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:21 2022] DELETE /identity/v3/projects/1001f3817eb04401b1b5d0b135c56ed0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:21.389269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.390731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.410249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:21.435226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6796f97d29f4887a7f32cfb285329f4', 'request_id': 'req-2274375e-a164-4293-bc27-0ee28fd844e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.445520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6796f97d29f4887a7f32cfb285329f4', 'request_id': 'req-2274375e-a164-4293-bc27-0ee28fd844e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.456324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6796f97d29f4887a7f32cfb285329f4', 'request_id': 'req-2274375e-a164-4293-bc27-0ee28fd844e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.483863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] The token cache is being invalidate because project f6796f97d29f4887a7f32cfb285329f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:21.484383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.485776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2274375e-a164-4293-bc27-0ee28fd844e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.492030 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 914/1821] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:21 2022] DELETE /identity/v3/projects/f6796f97d29f4887a7f32cfb285329f4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:21.494432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d862-ddbd-4eca-80f1-d60dcf4e910a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.494720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d862-ddbd-4eca-80f1-d60dcf4e910a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.495049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1d862-ddbd-4eca-80f1-d60dcf4e910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.507565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765d9b-33f6-485c-a094-b8bd1575ca8b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.542511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5cb1d862-ddbd-4eca-80f1-d60dcf4e910a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:21.543848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5cb1d862-ddbd-4eca-80f1-d60dcf4e910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.652892 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 915/1822] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:21.659501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.660101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.660661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.661671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.664282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.665425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.666513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] PATH_INFO: `/v3/users/be9e2309fea640a489d76421fe1d0574` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.669907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9e2309fea640a489d76421fe1d0574)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.675649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.759138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:21.766190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:21.806414 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 916/1823] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:21.813677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.836040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9e2309fea640a489d76421fe1d0574'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.836040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9e2309fea640a489d76421fe1d0574'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.854876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9e2309fea640a489d76421fe1d0574'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.862488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac893ca3-3c32-46d9-bdb1-8b59db92b560 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:21.868804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:21.869762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:21.870038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:21.870329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:21.871020 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:21.871322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:21.873249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:21.895121 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 917/1824] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:21.899826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9e2309fea640a489d76421fe1d0574'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.901277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:21.922384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9e2309fea640a489d76421fe1d0574'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:21.935543 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 908/1825] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:21 2022] DELETE /identity/v3/users/be9e2309fea640a489d76421fe1d0574 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:21.947405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927c2eb-a0aa-45eb-a3a1-361d271ba518 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.059995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.060910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.061260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.063211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.064142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.067732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.124803 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 918/1826] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:21 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:22.129420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.130942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.147174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0072-746c-4990-a60b-f8aa1d3ce412 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.197464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:22.239304 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.240473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.241805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.242353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.244578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.250987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.328277 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 909/1827] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:22 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:22.332096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.339805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:22.345378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5d4d2-6211-4eec-a764-87495c77aae2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.368803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.370685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.371188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.372994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.373605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.377480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.406468 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 919/1828] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:22.408135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.422899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc9e7b-6f12-4b8f-b053-9daaa1e2f82f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.437012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.437647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.437920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.438185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.438831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.440693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.446010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.450341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.467092 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 910/1829] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:22.470117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.474625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4f719-1dde-43f8-b058-b51c57e0bc45 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.485604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.487111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee31cd-463c-45a8-b660-acb20e7e0346 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.488247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.488520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.488784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] PATH_INFO: `/v3/projects/d433223202b34aae91afe77e5a19fbcc` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.490264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d433223202b34aae91afe77e5a19fbcc)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.492225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.500633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.501332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.501596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.501864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] PATH_INFO: `/v3/projects/b64289ce78b14aee8dfcf926097219b7/users/c9610487c76e4d16bdd81f0d81dd6f0c/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.522611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64289ce78b14aee8dfcf926097219b7, user_id=c9610487c76e4d16bdd81f0d81dd6f0c, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.525766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf15706-0565-4465-b16b-9a01e2119ed9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.546844 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 911/1830] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:22 2022] PUT /identity/v3/projects/b64289ce78b14aee8dfcf926097219b7/users/c9610487c76e4d16bdd81f0d81dd6f0c/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:22.560112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a53c-5f2a-4b22-b143-54c4a5c6e733 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.560400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a53c-5f2a-4b22-b143-54c4a5c6e733 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.562096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1a53c-5f2a-4b22-b143-54c4a5c6e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.580977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd433223202b34aae91afe77e5a19fbcc', 'request_id': 'req-4e6c814e-57f5-4b56-8819-d8162cca3a47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:22.588873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd433223202b34aae91afe77e5a19fbcc', 'request_id': 'req-4e6c814e-57f5-4b56-8819-d8162cca3a47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:22.599126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd433223202b34aae91afe77e5a19fbcc', 'request_id': 'req-4e6c814e-57f5-4b56-8819-d8162cca3a47'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:22.605702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6fc1a53c-5f2a-4b22-b143-54c4a5c6e733 None None] MFA Rules not processed for user `c9610487c76e4d16bdd81f0d81dd6f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:22.607117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6fc1a53c-5f2a-4b22-b143-54c4a5c6e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.615924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] The token cache is being invalidate because project d433223202b34aae91afe77e5a19fbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:22.616213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:22.616829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:22.618367 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 920/1831] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:22 2022] DELETE /identity/v3/projects/d433223202b34aae91afe77e5a19fbcc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:22.622104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.623951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.681622 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 912/1832] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:22.682979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.683270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.683652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.700664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c814e-57f5-4b56-8819-d8162cca3a47 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.704961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.705789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.705972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.707104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.707248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:22.707768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.708787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.813660 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 913/1833] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:22.814399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.815882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.838756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.841193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2592e-4534-4e99-8620-b238117ef263 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.853395 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 921/1834] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:22.854717 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.855002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.855724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.871606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:22.891526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:22.892781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:22.905015 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 922/1835] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:22.910101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.923520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26559fe5-4c29-42ee-8822-a8a77cdb6afc None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.947263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.948733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.949036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.949349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.950051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:22.950546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.952408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.959218 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33fbcd-2cf3-4f04-9ec6-4a075f7bf259 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.963481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.964485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.964603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.965334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.974293 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 923/1836] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:22.976083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:22.981809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:22.983540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:22.988948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a39d-1605-41f6-8431-755faa33d37e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:22.995736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:22.996126 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 914/1837] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:22.996881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:22.997309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:22.997681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:22.998481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.000583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.006105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:23.053611 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 924/1838] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:22 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:23.057815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.072325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef3ff5-1c00-4af3-97a2-0c5821d0c0d1 service glance] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.159336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.160091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.160300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.160591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.161351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.163221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.201106 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 915/1839] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:23 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:23.202479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.218910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf25f5-c706-407e-a835-9f35f2f443eb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.226217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.226880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.227288 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.227705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.228587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.230409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.243364 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 925/1840] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:23.248920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.263900 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a36b-42cc-4f64-a255-548fb82a4197 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.278728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.279383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.279659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.280049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.280721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.284480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b17792-e93a-48f6-8e37-869fb0bd6811 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.302601 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 916/1841] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:23.307284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.319393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90aece-0ddd-4340-ba67-fd7798cc4773 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.326166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.326961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.327305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.327739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] PATH_INFO: `/v3/projects/3f4268f9c682434d937ce8f4353c6252/users/6a06724179e4454ea6d2c9d7a037531e/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.381215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4268f9c682434d937ce8f4353c6252, user_id=6a06724179e4454ea6d2c9d7a037531e, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.387304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:23.431498 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 926/1842] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:23 2022] PUT /identity/v3/projects/3f4268f9c682434d937ce8f4353c6252/users/6a06724179e4454ea6d2c9d7a037531e/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:23.449349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.449636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.449904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.514002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] MFA Rules not processed for user `6a06724179e4454ea6d2c9d7a037531e`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:23.515590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:23.689252 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 917/1843] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:23.690138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:23.855167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cefc5-fad0-432c-8ee8-147bc4ecbe4a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:23.874198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:23.874974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:23.875346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:23.875748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:23.876616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:23.893129 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.015735 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 927/1844] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:23 2022] POST /identity/v3/projects => generated 385 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:24.021928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.040279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8199f-a560-4749-8b47-ea8b146e9fd9 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.079335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:24.176368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.179266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.180342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.181339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.183601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.187585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.234909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.236945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:24.244278 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 918/1845] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:24.247960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.259479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb135c-8982-4059-854d-e5263db17fe8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.266949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.267972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.268354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.268751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.271127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25ce43-6167-47c7-a55e-3977e77b2c70 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.278142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.279125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.279448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.279726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] PATH_INFO: `/v3/users/3aca3737ea4c40a89384bdf5e77d90f5` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.280540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.282994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aca3737ea4c40a89384bdf5e77d90f5)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.283518 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.285732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.299614 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 919/1846] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:24.304168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.319220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde9a0-94f3-4cbf-a018-5b07eb02f5a7 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.326642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.327464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.327810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.328187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.328934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.330735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.348467 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 920/1847] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:24.353268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.360288 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aca3737ea4c40a89384bdf5e77d90f5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.364275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25dcf2-5b8b-405e-81f3-7418df6579ef admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.370649 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aca3737ea4c40a89384bdf5e77d90f5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.370812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.371064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.371401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.371731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] PATH_INFO: `/v3/projects/f57c18c6bc1c49d3b46bb85706971663/users/9f13d798c7ca43f9ba49f34a2be76142/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.383431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aca3737ea4c40a89384bdf5e77d90f5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.387789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57c18c6bc1c49d3b46bb85706971663, user_id=9f13d798c7ca43f9ba49f34a2be76142, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.390623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.392638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aca3737ea4c40a89384bdf5e77d90f5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.393361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-871a3f2f-ea59-43ae-b646-e584c666f7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aca3737ea4c40a89384bdf5e77d90f5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.400872 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 928/1848] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:24 2022] DELETE /identity/v3/users/3aca3737ea4c40a89384bdf5e77d90f5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:24.410621 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 921/1849] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:24 2022] PUT /identity/v3/projects/f57c18c6bc1c49d3b46bb85706971663/users/9f13d798c7ca43f9ba49f34a2be76142/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:24.421067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.421422 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.422041 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.442236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:24.477247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] MFA Rules not processed for user `9f13d798c7ca43f9ba49f34a2be76142`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:24.479259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:24.597255 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 929/1850] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:24.602219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.604058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:24.668166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.669798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:24.691444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aa9db-5605-4e2c-ba65-1975b9c35ef0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.700379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.700379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.700379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.700379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.701111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.703374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.732136 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 922/1851] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:24.736186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.749884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba400ee-6e55-47e2-86f0-f3fa1dc83105 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.784308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:24.806603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd93b4e-247c-4746-a410-9de1240d72ee admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.813729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.814398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.814674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.815002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.815999 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.819604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.823561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.824251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.824583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.824854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] PATH_INFO: `/v3/projects/f9ecfb8b74ec4e03bc149b1e1b56c356` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.826225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ecfb8b74ec4e03bc149b1e1b56c356)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.828244 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.844559 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 923/1852] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/users => generated 298 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:24.848661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.861425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d4086-ea50-4523-9e8d-9517f23553f5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.866210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.866812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.867088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.867356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.868014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.869667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.876969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:24.879892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'request_id': 'req-80cc875f-39d3-4816-9e64-efed60bd55b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.884780 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 924/1853] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:24.885853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:24.889047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'request_id': 'req-80cc875f-39d3-4816-9e64-efed60bd55b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.895370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679228e-1242-4577-be65-83cdf9b72529 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:24.895634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ecfb8b74ec4e03bc149b1e1b56c356', 'request_id': 'req-80cc875f-39d3-4816-9e64-efed60bd55b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.916251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] The token cache is being invalidate because project f9ecfb8b74ec4e03bc149b1e1b56c356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:24.916588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.917159 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-80cc875f-39d3-4816-9e64-efed60bd55b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:24.918667 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 930/1854] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:24 2022] DELETE /identity/v3/projects/f9ecfb8b74ec4e03bc149b1e1b56c356 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:24.923874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d330-0926-4131-a873-7fe9d0bf75ca None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.924156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d330-0926-4131-a873-7fe9d0bf75ca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.924480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2d330-0926-4131-a873-7fe9d0bf75ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.946829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-24e2d330-0926-4131-a873-7fe9d0bf75ca None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:24.948053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-24e2d330-0926-4131-a873-7fe9d0bf75ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:24.955687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:24.956453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:24.956670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:24.956911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] PATH_INFO: `/v3/projects/411bfae72b90444a9d6730c4a11ed301/users/38736c62943b49dea651256c9fa661a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:24.973964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bfae72b90444a9d6730c4a11ed301, user_id=38736c62943b49dea651256c9fa661a2, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:24.977211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:24.994833 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 925/1855] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:24 2022] PUT /identity/v3/projects/411bfae72b90444a9d6730c4a11ed301/users/38736c62943b49dea651256c9fa661a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:25.002074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.010709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.023120 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 931/1856] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:25.031199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.031542 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.031922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.056802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:25.058258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.093641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21e2e-2ee2-41e2-afe8-4b50c3fa1687 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.098782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.099336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.099607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.099889 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.100545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.102528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.113570 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 926/1857] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:25.114260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.116066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.124547 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 932/1858] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:25.125407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.129589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378ba54-2185-4322-a4e4-6162126e9a85 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.134796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae9847-1a57-4421-bff2-1461a37b3490 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.138189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.138916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.139283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.139383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.139721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] PATH_INFO: `/v3/users/8f0ea9a6bc2e4606b3a6041ab727bbe9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.139992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.140609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.140609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] PATH_INFO: `/v3/projects/411bfae72b90444a9d6730c4a11ed301/users/38736c62943b49dea651256c9fa661a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.141740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0ea9a6bc2e4606b3a6041ab727bbe9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.142584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411bfae72b90444a9d6730c4a11ed301, user_id=38736c62943b49dea651256c9fa661a2, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.144179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.145275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.157589 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 933/1859] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:25 2022] PUT /identity/v3/projects/411bfae72b90444a9d6730c4a11ed301/users/38736c62943b49dea651256c9fa661a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:25.166304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.188800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:25.201378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0ea9a6bc2e4606b3a6041ab727bbe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:25.202197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0ea9a6bc2e4606b3a6041ab727bbe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:25.212267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0ea9a6bc2e4606b3a6041ab727bbe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:25.233042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0ea9a6bc2e4606b3a6041ab727bbe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:25.239606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a2072-e8a6-446f-bd42-2765fb4eb333 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.240164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-699dcb78-4428-49e9-93cf-06fe21329d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0ea9a6bc2e4606b3a6041ab727bbe9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:25.245547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.246283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.246543 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 927/1860] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:25 2022] DELETE /identity/v3/users/8f0ea9a6bc2e4606b3a6041ab727bbe9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:25.246659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.246815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.247870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:25.248019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.248175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.248295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.248563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.249933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8803e-2f0a-4674-9c53-d45c6d06ee07 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.252609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:25.274007 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 934/1861] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:25.275588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.275874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.276143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.286205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] MFA Rules not processed for user `38736c62943b49dea651256c9fa661a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:25.287896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.296410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:25.297495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.361055 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 935/1862] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:25.361927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.371104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.382391 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 928/1863] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:25.383246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628a60a-1b9d-4b13-9fef-e90f48fb6001 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.383378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.384510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.394886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.395529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.395799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.396068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.396706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.398667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.431855 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 936/1864] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:25.431855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.431855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.447026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d6d50-4286-48a3-bb69-5a66e4a96121 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.492678 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f83a5-e0ce-4522-9431-694ea9aa3600 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.496648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.497428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.497808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.497927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.498251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.498432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.498861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.499220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.500362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.505867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:25.568857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.569313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.570430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.571162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.581365 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 929/1865] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:25.581923 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 937/1866] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:25.582258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.592694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd556d-e04c-483d-964e-7217b07d8aa0 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.597361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.597963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.598233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.598493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.599113 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.601028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.627978 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 930/1867] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:25.632226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.651809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028425ae-6a88-4077-a796-3cefc209fd07 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.659595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.660279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.660582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.660860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.661570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.663846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.676886 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 938/1868] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:25.680668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.692533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161dc0-c50b-4930-b8ed-bfa1d1b9bdd8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.698356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.698648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.698920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.699147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.700032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.701805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ce756-6e96-4a72-a4ae-fa0bc892be80 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.713425 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 931/1869] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:25.717662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:25.728672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e81a-1dbd-41a6-867c-5460629d841e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:25.734301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:25.734983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.735257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.735516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] PATH_INFO: `/v3/projects/94363b1b0a0d48229b3bef2b1b779d2e/users/2da699bb0c51440593b8175d05869203/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.757153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94363b1b0a0d48229b3bef2b1b779d2e, user_id=2da699bb0c51440593b8175d05869203, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:25.760171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:25.763052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:25.784597 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 939/1870] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:25 2022] PUT /identity/v3/projects/94363b1b0a0d48229b3bef2b1b779d2e/users/2da699bb0c51440593b8175d05869203/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:25.790161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:25.790505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:25.790789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:25.816397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:25.817868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:25.899552 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 932/1871] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:25.910544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:26.007487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:26.007487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:26.034651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607785a1-6bfa-4b21-9dc8-5b59ccbbf888 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:26.041449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:26.042656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:26.043577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:26.043937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:26.044365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b182f4-4136-49b5-b19d-ba745af98812 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:26.051278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:26.051942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:26.052316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:26.055659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] PATH_INFO: `/v3/projects/3cbdd121edf94af7a1cd6f66eb9c0e42` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:26.055659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbdd121edf94af7a1cd6f66eb9c0e42)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:26.055952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:26.057050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:26.057180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:26.069206 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 940/1872] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:26.117195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbdd121edf94af7a1cd6f66eb9c0e42', 'request_id': 'req-34c18e6b-d803-4502-9241-b4bf109fe737'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.123283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbdd121edf94af7a1cd6f66eb9c0e42', 'request_id': 'req-34c18e6b-d803-4502-9241-b4bf109fe737'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.129941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbdd121edf94af7a1cd6f66eb9c0e42', 'request_id': 'req-34c18e6b-d803-4502-9241-b4bf109fe737'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.141023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:26.147671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] The token cache is being invalidate because project 3cbdd121edf94af7a1cd6f66eb9c0e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:26.148112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.149155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.151398 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 933/1873] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:26 2022] DELETE /identity/v3/projects/3cbdd121edf94af7a1cd6f66eb9c0e42 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:26.155953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:26.166183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffc92a-a3c8-4c37-b5d8-c9acfcfcf8df service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:26.234232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:26.234895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:26.235208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:26.235445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] PATH_INFO: `/v3/users/fa5a65771e96496fb749c02f30707c79` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:26.236608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5a65771e96496fb749c02f30707c79)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:26.238665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:26.297279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5a65771e96496fb749c02f30707c79'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.306030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5a65771e96496fb749c02f30707c79'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.319216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5a65771e96496fb749c02f30707c79'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.328176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5a65771e96496fb749c02f30707c79'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.328923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5a65771e96496fb749c02f30707c79'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:26.335719 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 941/1874] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:26 2022] DELETE /identity/v3/users/fa5a65771e96496fb749c02f30707c79 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:26.932054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:26.933698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:26.984626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18e6b-d803-4502-9241-b4bf109fe737 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:27.126915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:27.127596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.127873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.128146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] PATH_INFO: `/v3/projects/2b40d83d4c04419284aaaacad1c60f51` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.129435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b40d83d4c04419284aaaacad1c60f51)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:27.136788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:27.234519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b40d83d4c04419284aaaacad1c60f51', 'request_id': 'req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.241264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b40d83d4c04419284aaaacad1c60f51', 'request_id': 'req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.250273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b40d83d4c04419284aaaacad1c60f51', 'request_id': 'req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.273642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] The token cache is being invalidate because project 2b40d83d4c04419284aaaacad1c60f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:27.274604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.275489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.278080 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 934/1875] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:26 2022] DELETE /identity/v3/projects/2b40d83d4c04419284aaaacad1c60f51 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:27.282335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:27.283628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:27.298586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fbc5c-c385-4398-ae38-728fac266b05 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:27.337810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:27.441662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:27.444664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:27.449234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:27.450026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.450390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.450729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] PATH_INFO: `/v3/users/c4d60ef4846a4b10ae903fe0b027224d` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.451921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d60ef4846a4b10ae903fe0b027224d)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:27.453998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:27.530743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d60ef4846a4b10ae903fe0b027224d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.542964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a24c1-7767-47c8-b7a2-a4ddf0b1efa8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:27.549525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d60ef4846a4b10ae903fe0b027224d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.552462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:27.553194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:27.553532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:27.553855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:27.555819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:27.569102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d60ef4846a4b10ae903fe0b027224d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.579789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d60ef4846a4b10ae903fe0b027224d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.580765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d60ef4846a4b10ae903fe0b027224d'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:27.590203 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 942/1876] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:27 2022] DELETE /identity/v3/users/c4d60ef4846a4b10ae903fe0b027224d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:27.621642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:27.685179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:27.690759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:27.725627 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 935/1877] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:28.061488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:28.063373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:28.192922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d74973-f56b-41ad-8cdf-5317a6a2f4c6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:28.199323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:28.200022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:28.200430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:28.201461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] PATH_INFO: `/v3/projects/94577750ea4f4ff89a6a9506950debcf` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:28.202780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] RBAC: Authorizing `identity:delete_project(project_id=94577750ea4f4ff89a6a9506950debcf)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:28.205145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:28.294979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:28.340724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94577750ea4f4ff89a6a9506950debcf', 'request_id': 'req-277e4b9a-68d5-429d-97ab-4fb3bb22264a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:28.356519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94577750ea4f4ff89a6a9506950debcf', 'request_id': 'req-277e4b9a-68d5-429d-97ab-4fb3bb22264a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:28.379529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94577750ea4f4ff89a6a9506950debcf', 'request_id': 'req-277e4b9a-68d5-429d-97ab-4fb3bb22264a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:28.415355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] The token cache is being invalidate because project 94577750ea4f4ff89a6a9506950debcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:28.415668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:28.417747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-277e4b9a-68d5-429d-97ab-4fb3bb22264a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:28.422087 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 943/1878] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:28 2022] DELETE /identity/v3/projects/94577750ea4f4ff89a6a9506950debcf => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:28.784264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:28.793003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f0c6-75f6-4368-9355-5a989b5e729e service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:28.847449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:28.848224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:28.848505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:28.848776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:28.850638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:28.920325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:28.921835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:28.932985 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 936/1879] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:31.483167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:31.483681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:31.483795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:31.539986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] MFA Rules not processed for user `2da699bb0c51440593b8175d05869203`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:31.541970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:31.673150 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 944/1880] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:31.690475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:31.691914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:31.790395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f74f-6c86-46e9-beca-a08846c2eadc service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:31.797277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:31.797955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:31.798257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:31.798527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:31.810507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:31.810507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75eb58-8727-408c-81a8-cff1511e6cd1 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:31.823214 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 937/1881] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:33.202033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:33.203986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:33.295509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab226ee2-19a4-4ef0-b9ea-adff1e422f96 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:33.300382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:33.301094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:33.301498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:33.301768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] PATH_INFO: `/v3/users/6a06724179e4454ea6d2c9d7a037531e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:33.303151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a06724179e4454ea6d2c9d7a037531e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:33.305356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:33.370817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1d15-0dd6-4375-bb91-856f5e86f2fc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:33.372246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1d15-0dd6-4375-bb91-856f5e86f2fc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:33.373069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a1d15-0dd6-4375-bb91-856f5e86f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:33.376526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a06724179e4454ea6d2c9d7a037531e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:33.386160 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a06724179e4454ea6d2c9d7a037531e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:33.388758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:33.398846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-040a1d15-0dd6-4375-bb91-856f5e86f2fc None None] MFA Rules not processed for user `2da699bb0c51440593b8175d05869203`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:33.401042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-040a1d15-0dd6-4375-bb91-856f5e86f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:33.405494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a06724179e4454ea6d2c9d7a037531e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:33.409523 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 938/1882] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:33.418945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a06724179e4454ea6d2c9d7a037531e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:33.419984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a06724179e4454ea6d2c9d7a037531e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:33.426959 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 945/1883] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:33 2022] DELETE /identity/v3/users/6a06724179e4454ea6d2c9d7a037531e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:33.431894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:33.432182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:33.432483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:33.454062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:33.455509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:33.463330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:33.532604 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 939/1884] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:33.544075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:33.546745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:33.615733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe4113-82fb-4ccc-a046-5b536864e5df admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:33.621697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:33.623002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:33.623281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:33.623547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:33.642949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:33.644590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:33.660642 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 946/1885] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:34.445638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:34.447697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:34.462819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7f634-9fb4-4822-9e95-66ca0e47ffe4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:34.468957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:34.469800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:34.470384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:34.471098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] PATH_INFO: `/v3/projects/3f4268f9c682434d937ce8f4353c6252` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:34.472948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4268f9c682434d937ce8f4353c6252)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:34.475253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:34.563177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4268f9c682434d937ce8f4353c6252', 'request_id': 'req-09c5bbe6-353c-4de3-afe2-fd107595a0e5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.570655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4268f9c682434d937ce8f4353c6252', 'request_id': 'req-09c5bbe6-353c-4de3-afe2-fd107595a0e5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.578275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4268f9c682434d937ce8f4353c6252', 'request_id': 'req-09c5bbe6-353c-4de3-afe2-fd107595a0e5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.599380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] The token cache is being invalidate because project 3f4268f9c682434d937ce8f4353c6252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:34.599677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.600488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.602739 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 940/1886] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:34 2022] DELETE /identity/v3/projects/3f4268f9c682434d937ce8f4353c6252 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:34.608443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:34.621329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3e42-dde5-41cf-83b8-0da637af13bd service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:34.717339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:34.718153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:34.718535 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:34.718888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] PATH_INFO: `/v3/users/9f13d798c7ca43f9ba49f34a2be76142` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:34.720317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f13d798c7ca43f9ba49f34a2be76142)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:34.742506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:34.824730 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f13d798c7ca43f9ba49f34a2be76142'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.835419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f13d798c7ca43f9ba49f34a2be76142'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.852614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f13d798c7ca43f9ba49f34a2be76142'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.859441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:34.863986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f13d798c7ca43f9ba49f34a2be76142'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.865009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f13d798c7ca43f9ba49f34a2be76142'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:34.875145 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 947/1887] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:34 2022] DELETE /identity/v3/users/9f13d798c7ca43f9ba49f34a2be76142 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:35.225662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:35.227849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:35.253479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5bbe6-353c-4de3-afe2-fd107595a0e5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:35.367909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:35.368137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:35.368410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:35.368676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] PATH_INFO: `/v3/projects/f57c18c6bc1c49d3b46bb85706971663` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:35.369921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57c18c6bc1c49d3b46bb85706971663)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:35.372089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:35.441890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:35.456326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57c18c6bc1c49d3b46bb85706971663', 'request_id': 'req-6370a09a-8269-43ff-80cf-ba9368d2b072'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.467763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57c18c6bc1c49d3b46bb85706971663', 'request_id': 'req-6370a09a-8269-43ff-80cf-ba9368d2b072'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.477002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57c18c6bc1c49d3b46bb85706971663', 'request_id': 'req-6370a09a-8269-43ff-80cf-ba9368d2b072'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.508477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] The token cache is being invalidate because project f57c18c6bc1c49d3b46bb85706971663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:35.509092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.510196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.515344 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 941/1888] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:35 2022] DELETE /identity/v3/projects/f57c18c6bc1c49d3b46bb85706971663 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:35.516617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:35.518290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:35.542986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fb718-18be-4c6c-8213-0bed262b7855 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:35.663210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:35.663922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:35.664142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:35.664549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] PATH_INFO: `/v3/users/38736c62943b49dea651256c9fa661a2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:35.665984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=38736c62943b49dea651256c9fa661a2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:35.668517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:35.761712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38736c62943b49dea651256c9fa661a2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.772097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38736c62943b49dea651256c9fa661a2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.789016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38736c62943b49dea651256c9fa661a2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.798643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38736c62943b49dea651256c9fa661a2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.799455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38736c62943b49dea651256c9fa661a2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:35.818661 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 948/1889] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:35 2022] DELETE /identity/v3/users/38736c62943b49dea651256c9fa661a2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:36.147831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:36.150556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:36.164322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a09a-8269-43ff-80cf-ba9368d2b072 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:36.228617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:36.230043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:36.230532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:36.230844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] PATH_INFO: `/v3/projects/411bfae72b90444a9d6730c4a11ed301` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:36.237172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=411bfae72b90444a9d6730c4a11ed301)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:36.239311 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:36.302921 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411bfae72b90444a9d6730c4a11ed301', 'request_id': 'req-bda4db3d-4400-4321-9075-91533c84f69e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:36.313823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411bfae72b90444a9d6730c4a11ed301', 'request_id': 'req-bda4db3d-4400-4321-9075-91533c84f69e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:36.321671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411bfae72b90444a9d6730c4a11ed301', 'request_id': 'req-bda4db3d-4400-4321-9075-91533c84f69e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:36.335662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] The token cache is being invalidate because project 411bfae72b90444a9d6730c4a11ed301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:36.336265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:36.336998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:36.338785 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 942/1890] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:36 2022] DELETE /identity/v3/projects/411bfae72b90444a9d6730c4a11ed301 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:45.802364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:46.332500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:47.117668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:47.119220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:47.134010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcf35-a617-4709-81dd-25cbdc0f5dec admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:47.196486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:47.197153 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:47.197432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:47.197729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] PATH_INFO: `/v3/users/b44fd5c928ea4a4289f24e6b825b98fa` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:47.198845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44fd5c928ea4a4289f24e6b825b98fa)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:47.200769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:47.248540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44fd5c928ea4a4289f24e6b825b98fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.256557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44fd5c928ea4a4289f24e6b825b98fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.269577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44fd5c928ea4a4289f24e6b825b98fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.277554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44fd5c928ea4a4289f24e6b825b98fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.278257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44fd5c928ea4a4289f24e6b825b98fa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.284465 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 949/1891] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:47 2022] DELETE /identity/v3/users/b44fd5c928ea4a4289f24e6b825b98fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:47.490319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:47.493289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:47.529746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4db3d-4400-4321-9075-91533c84f69e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:47.602190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:47.602892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:47.603168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:47.603478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] PATH_INFO: `/v3/projects/925b11e4612b49f88fa6812d55e15c0c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:47.604939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925b11e4612b49f88fa6812d55e15c0c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:47.607258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:47.671654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925b11e4612b49f88fa6812d55e15c0c', 'request_id': 'req-0149cc2b-7433-4501-9d34-d12c79ace442'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.683733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925b11e4612b49f88fa6812d55e15c0c', 'request_id': 'req-0149cc2b-7433-4501-9d34-d12c79ace442'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.692691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925b11e4612b49f88fa6812d55e15c0c', 'request_id': 'req-0149cc2b-7433-4501-9d34-d12c79ace442'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.717837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] The token cache is being invalidate because project 925b11e4612b49f88fa6812d55e15c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:47.717837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.717837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.718416 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 943/1892] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:47 2022] DELETE /identity/v3/projects/925b11e4612b49f88fa6812d55e15c0c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:47.723349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:47.724865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:47.738286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44a934-0712-4fb4-8327-131442981d86 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:47.798099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:47.802102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:47.802381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:47.802655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] PATH_INFO: `/v3/users/fe26bde03a294d6a9823c8962aa20d40` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:47.803830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe26bde03a294d6a9823c8962aa20d40)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:47.805793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:47.829092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:47.862266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe26bde03a294d6a9823c8962aa20d40'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.870541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe26bde03a294d6a9823c8962aa20d40'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.883151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe26bde03a294d6a9823c8962aa20d40'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.890301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe26bde03a294d6a9823c8962aa20d40'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.891011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-61d2a128-b709-437d-910d-1da0edb8b042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe26bde03a294d6a9823c8962aa20d40'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:47.897143 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 950/1893] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:47 2022] DELETE /identity/v3/users/fe26bde03a294d6a9823c8962aa20d40 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:48.078048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.079723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.100000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149cc2b-7433-4501-9d34-d12c79ace442 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.163256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.163924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.164174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.164562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] PATH_INFO: `/v3/projects/c1e115ef8d8f49068913fd64013f97f9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.165793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e115ef8d8f49068913fd64013f97f9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.167920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.206749 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:48.221276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e115ef8d8f49068913fd64013f97f9', 'request_id': 'req-8b48cd69-52a2-4951-a971-360d7bf6c371'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:48.228515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e115ef8d8f49068913fd64013f97f9', 'request_id': 'req-8b48cd69-52a2-4951-a971-360d7bf6c371'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:48.236633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e115ef8d8f49068913fd64013f97f9', 'request_id': 'req-8b48cd69-52a2-4951-a971-360d7bf6c371'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:48.250654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] The token cache is being invalidate because project c1e115ef8d8f49068913fd64013f97f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:48.250937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:48.251558 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8b48cd69-52a2-4951-a971-360d7bf6c371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:48.253168 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 944/1894] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:48 2022] DELETE /identity/v3/projects/c1e115ef8d8f49068913fd64013f97f9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:48.258974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.259480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.259583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.279116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:48.280308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.343546 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 951/1895] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:48.355525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.356114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.356402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.378006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:48.379233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.387250 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 945/1896] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:48.391864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.402083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34332586-f328-4027-ad5d-f9f166f3db63 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.406642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.407251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.407522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.407835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.408523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:48.408827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.410441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.423138 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 952/1897] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:57:48.427596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.438884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e624a5-6130-463c-a2a8-0323cab69b3c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.444033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.444767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.445078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.445352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.446016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.447934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.482198 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 946/1898] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:48.483368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.494132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff23a-6ba2-484b-a15b-a0d3a2921186 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.552334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.552987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.553260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.553523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.554155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.556120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.577966 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 953/1899] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:48.582092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.592199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d228a-4008-4d0c-98b4-775d6beea199 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.597054 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.597655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.597954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.598221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.598858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.600502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.613685 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 947/1900] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:48.617795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.627992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1ef0d-a84c-4afd-af66-703e514fcfe8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.632736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.633375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.633647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.633920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.634564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.636167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af762-9b12-4aa9-ba33-4f0cca0beaca admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.647757 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 954/1901] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:48.651996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.662195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f770c-dc4a-4947-995a-cd3f1e00fcfb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.667107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.667739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.667992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.668256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] PATH_INFO: `/v3/projects/b94bcc9f48f74e5c847eceefaef24479/users/6cf65b41747a459bbcf823fddb0147e7/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.685828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94bcc9f48f74e5c847eceefaef24479, user_id=6cf65b41747a459bbcf823fddb0147e7, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.686643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.702026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 948/1902] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:48 2022] PUT /identity/v3/projects/b94bcc9f48f74e5c847eceefaef24479/users/6cf65b41747a459bbcf823fddb0147e7/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:48.712676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.715632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.715922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.728052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:48.753205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] MFA Rules not processed for user `6cf65b41747a459bbcf823fddb0147e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:48.754474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.832496 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 955/1903] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:48.844008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:48.845835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:48.905685 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019b203-bc80-4e95-83fb-c135b4e96e74 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:48.910717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:48.911404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:48.911761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:48.912093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:48.921732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:48.923264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:48.934088 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 949/1904] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:48.956636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.003020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.004603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.043489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f7c31-718b-4d52-a13f-9d1468ef0451 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:49.049731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:49.050424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.050699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.050963 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] PATH_INFO: `/v3/users/6cf65b41747a459bbcf823fddb0147e7` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.052300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf65b41747a459bbcf823fddb0147e7)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:49.054506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:49.119088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316c2e-eb3c-45e9-9f9b-9df210ff5fe5 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:49.119833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf65b41747a459bbcf823fddb0147e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.129330 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:49.130117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.130511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf65b41747a459bbcf823fddb0147e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.131602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.132434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] PATH_INFO: `/v3/users/c9610487c76e4d16bdd81f0d81dd6f0c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.134081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9610487c76e4d16bdd81f0d81dd6f0c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:49.136596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:49.140451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:49.151156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf65b41747a459bbcf823fddb0147e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.166437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf65b41747a459bbcf823fddb0147e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.167291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9dfd9147-935f-461c-9224-8d4934c44a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf65b41747a459bbcf823fddb0147e7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.178307 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 956/1905] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:48 2022] DELETE /identity/v3/users/6cf65b41747a459bbcf823fddb0147e7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:49.182719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.183644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.183644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.205846 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:49.207066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.215820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9610487c76e4d16bdd81f0d81dd6f0c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.216872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:49.217333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9610487c76e4d16bdd81f0d81dd6f0c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.227353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9610487c76e4d16bdd81f0d81dd6f0c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.242096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9610487c76e4d16bdd81f0d81dd6f0c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.250519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c98acca4-4b14-416d-81e3-57f1ac6d23ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9610487c76e4d16bdd81f0d81dd6f0c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:49.258824 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 950/1906] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:49 2022] DELETE /identity/v3/users/c9610487c76e4d16bdd81f0d81dd6f0c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:49.263239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.263586 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.263930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.284049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:49.284276 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 957/1907] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:49.285367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.292084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.293657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.348981 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 951/1908] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:49.357313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.363984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f699fd-f9d8-407a-afed-6dcdd184479e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:49.414051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d2b1b-2cff-49ee-a5c0-59d60b86660a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:49.416712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:49.417732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.418066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.418408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.419632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:49.420309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.420589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.420976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.428659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:49.430398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:49.432760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:49.434365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:49.441153 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 958/1909] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:49.444507 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 952/1910] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 00:57:49.928797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.930361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.935210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:49.936740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:49.951442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff738a-107e-4295-9af1-5122a89eaf65 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:49.956575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:49.957341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:49.957774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:49.958119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] PATH_INFO: `/v3/projects/b64289ce78b14aee8dfcf926097219b7` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:49.959657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64289ce78b14aee8dfcf926097219b7)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:49.964294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:49.987040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:49.996072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c438e-51d2-47bb-919d-912ee8375fea service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.010130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.011672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.012804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.013321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] PATH_INFO: `/v3/projects/b94bcc9f48f74e5c847eceefaef24479` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.014616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94bcc9f48f74e5c847eceefaef24479)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.016764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.029081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64289ce78b14aee8dfcf926097219b7', 'request_id': 'req-55b4ece8-175f-4f11-958b-89bfcae19be7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.035436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64289ce78b14aee8dfcf926097219b7', 'request_id': 'req-55b4ece8-175f-4f11-958b-89bfcae19be7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.042734 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64289ce78b14aee8dfcf926097219b7', 'request_id': 'req-55b4ece8-175f-4f11-958b-89bfcae19be7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.057294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] The token cache is being invalidate because project b64289ce78b14aee8dfcf926097219b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:50.057710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.058761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-55b4ece8-175f-4f11-958b-89bfcae19be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.061796 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 953/1911] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:49 2022] DELETE /identity/v3/projects/b64289ce78b14aee8dfcf926097219b7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:50.067287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d486f5-02d0-4b7a-8877-dc1efb652182 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.067572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d486f5-02d0-4b7a-8877-dc1efb652182 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.067856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d486f5-02d0-4b7a-8877-dc1efb652182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.086305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94bcc9f48f74e5c847eceefaef24479', 'request_id': 'req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.088584 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f7d486f5-02d0-4b7a-8877-dc1efb652182 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.089613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f7d486f5-02d0-4b7a-8877-dc1efb652182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.097196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94bcc9f48f74e5c847eceefaef24479', 'request_id': 'req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.105841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94bcc9f48f74e5c847eceefaef24479', 'request_id': 'req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.111376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:50.124932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] The token cache is being invalidate because project b94bcc9f48f74e5c847eceefaef24479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:50.125544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.126627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1d6f8ad9-2bea-4994-a344-c12f993e5c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:50.129597 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 959/1912] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:49 2022] DELETE /identity/v3/projects/b94bcc9f48f74e5c847eceefaef24479 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:50.134868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2339-4088-4e48-98fc-d6204a3cf1eb None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.135427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2339-4088-4e48-98fc-d6204a3cf1eb None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.135722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a2339-4088-4e48-98fc-d6204a3cf1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.157594 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 954/1913] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:50.160192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a58a2339-4088-4e48-98fc-d6204a3cf1eb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.161784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a58a2339-4088-4e48-98fc-d6204a3cf1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.166273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.166569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.166820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.172937 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 960/1914] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:50.181800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.182383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.182850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.188785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.190065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.203722 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 955/1915] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:50.208000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.210506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.211706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.221462 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 961/1916] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:57:50.225443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.236689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f426e2-fe24-452f-ae80-9728c1fe8164 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.239580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63546-88ea-471d-8e43-1a34744af7bc None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.245466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.246436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.246908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.247431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.248304 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:50.248431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.249095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.249373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.249652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.250031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.250334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:50.250661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.252379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.252856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.272382 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 956/1917] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:50.273891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.278133 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 962/1918] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:50.279234 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.289323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c966e-fca1-4ba2-90da-5d46444a5610 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.298600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.299307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.302227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.302227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.302227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.303477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.309170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f041d27-a5aa-4b80-97a1-305c13abc241 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.320474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.321231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.322488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.322787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.323612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.326473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.372483 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 963/1919] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:50.376560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.378061 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 957/1920] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:50.381448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.453888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991f696-4600-47fd-a717-fb33a9cb17dc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.459215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.459928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.460279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.460618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.461389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.463475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.465995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53cfd-b7ac-4446-ad63-4ce098ee8f3c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.472488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.473387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.473660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.473926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.475415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.479185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.489875 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 964/1921] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:50.493641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.495843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:50.506775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf9829-162a-46b3-8842-0e224f4034af admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.512826 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 958/1922] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:57:50.513666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.514194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.514480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.514826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.515262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.516109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.517880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.526134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03242a-3a4b-4bcb-87cc-3ebc0c3c68d6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.530796 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 965/1923] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:50.534720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.535033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.535509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.535822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.536191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.536986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.539074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.549239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067e3-b5b5-491c-ae32-8a9e8ed287a0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.554166 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 959/1924] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:50.555814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.556116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.557072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.557447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.557818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.558568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.560862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.569207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c9294-35dc-4f60-9763-ed76bc4f94f6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.576543 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 966/1925] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:50.579766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.580407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.580681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.580866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.580983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.581613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.583572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.592262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09df2f-e5c5-4285-af7f-439f6d5706e7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.597344 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 960/1926] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:50.598867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.600375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.600748 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.601454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] PATH_INFO: `/v3/projects/4e45f2daf83f49a5b8194803286c1272/users/6ed7118715014cbf98f41675bbf383ec/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.602247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.613362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fde5f5-4d40-46a4-acc7-4c5f94257967 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.619114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.619938 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.620752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.621417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] PATH_INFO: `/v3/projects/64785d2524bb48b8bf74b3d21f298de9/users/a6342a85ada946de97b3ca37ae043ab9/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.623179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e45f2daf83f49a5b8194803286c1272, user_id=6ed7118715014cbf98f41675bbf383ec, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.627497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ba195-c132-406a-aecb-4f6087aec17f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.638901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64785d2524bb48b8bf74b3d21f298de9, user_id=a6342a85ada946de97b3ca37ae043ab9, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.643062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d76b-44b9-4d21-be59-c6681b56d668 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.648916 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 967/1927] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:50 2022] PUT /identity/v3/projects/4e45f2daf83f49a5b8194803286c1272/users/6ed7118715014cbf98f41675bbf383ec/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:50.658253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.658650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.659381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.672079 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 961/1928] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:50 2022] PUT /identity/v3/projects/64785d2524bb48b8bf74b3d21f298de9/users/a6342a85ada946de97b3ca37ae043ab9/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:57:50.683319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.683319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.683319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.715929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] MFA Rules not processed for user `6ed7118715014cbf98f41675bbf383ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.717345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.720348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] MFA Rules not processed for user `a6342a85ada946de97b3ca37ae043ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:50.722230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.766868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:50.801274 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 968/1929] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:50.805869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.812796 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 962/1930] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:50.824932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.827248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:50.887393 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016c630-8787-4ee5-842e-ad8abe96bb67 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.892048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.892772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.893124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.893396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.894026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.895937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.897134 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb3df2-084e-4d36-9ee3-d67337236a9f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.902420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:50.903448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:50.903824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:50.904191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:50.915765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:50.917681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:50.930069 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 963/1931] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:50.930571 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 969/1932] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:50.932118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:50.945269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e70-1fdb-47ed-97b7-a0c185552767 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:50.995493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:51.029627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.030256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.030532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.030798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.031436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.033506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.059221 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 964/1933] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:50 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:51.062977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:51.076431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002a40-5bcf-4463-bc41-03203a13d243 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:51.090718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.091369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.091695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.092053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.092749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.094895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.107809 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 970/1934] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:57:51.113361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:51.124865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c8da-d3dd-443e-8adb-c6b0c00de388 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:51.132030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.132948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.133387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.133861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] PATH_INFO: `/v3/projects/874d845d384e445294c74833054ed1fa/users/7fe7f1a532ed416394bd28f7b1cb5009/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.166808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d845d384e445294c74833054ed1fa, user_id=7fe7f1a532ed416394bd28f7b1cb5009, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.169884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.184096 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 965/1935] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:51 2022] PUT /identity/v3/projects/874d845d384e445294c74833054ed1fa/users/7fe7f1a532ed416394bd28f7b1cb5009/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:51.188076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:51.200526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8295969-edef-424f-9592-d07708810f81 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:51.298973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.299498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.299768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.300029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.300674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.302333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee93ee-e5ac-44b8-9ff6-bb2edd5389ff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.314013 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 971/1936] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:51.318029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:51.329189 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fa415-ceee-47ee-8f51-30bc8bcb176b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:51.334098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.334785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.335058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.335332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] PATH_INFO: `/v3/projects/874d845d384e445294c74833054ed1fa/users/7fe7f1a532ed416394bd28f7b1cb5009/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.337450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874d845d384e445294c74833054ed1fa, user_id=7fe7f1a532ed416394bd28f7b1cb5009, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.340289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.353424 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 966/1937] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:51 2022] PUT /identity/v3/projects/874d845d384e445294c74833054ed1fa/users/7fe7f1a532ed416394bd28f7b1cb5009/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:51.364295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.364647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.365099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.394525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] MFA Rules not processed for user `7fe7f1a532ed416394bd28f7b1cb5009`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:51.395815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:51.443621 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:51.471914 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 972/1938] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:51.483354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:51.548069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0024c-27ea-47a3-89a3-42d02b0c4a94 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:51.553168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:51.553952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:51.554372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:51.554783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:51.616243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:51.617730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da60a40-ae7a-4717-925b-c7ab09463cd2 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:51.628396 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 967/1939] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:54.194708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:54.259192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da9b3-54c3-41f3-8dab-7cbcee331310 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:54.265006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:54.265631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:54.265898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:54.266217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] PATH_INFO: `/v3/users/6ed7118715014cbf98f41675bbf383ec` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:54.267426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed7118715014cbf98f41675bbf383ec)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:54.269426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:54.318960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed7118715014cbf98f41675bbf383ec'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.326687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed7118715014cbf98f41675bbf383ec'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.338246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed7118715014cbf98f41675bbf383ec'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.344945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed7118715014cbf98f41675bbf383ec'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.345643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed7118715014cbf98f41675bbf383ec'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.351945 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 973/1940] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:54 2022] DELETE /identity/v3/users/6ed7118715014cbf98f41675bbf383ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:54.356509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:54.357012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:54.357123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:54.377080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:54.378954 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:54.425215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:54.446750 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 968/1941] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:54.456869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:54.458432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:54.517525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52666e00-e1a6-48a8-b421-eb43232ed760 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:54.521325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:54.521954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:54.522228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:54.522518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:54.531753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:54.533227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:54.537082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:54.543436 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 974/1942] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:54.820508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:54.822194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:54.839782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ff59a-3fb2-4d64-b1f6-4a8d41e9fe35 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:54.848196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:54.849118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:54.849430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:54.849678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] PATH_INFO: `/v3/projects/4e45f2daf83f49a5b8194803286c1272` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:54.851418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e45f2daf83f49a5b8194803286c1272)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:54.853446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:54.904987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e45f2daf83f49a5b8194803286c1272', 'request_id': 'req-575ae4f5-06f0-4c07-be04-273db534ee66'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.912842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e45f2daf83f49a5b8194803286c1272', 'request_id': 'req-575ae4f5-06f0-4c07-be04-273db534ee66'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.920079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e45f2daf83f49a5b8194803286c1272', 'request_id': 'req-575ae4f5-06f0-4c07-be04-273db534ee66'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.934754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] The token cache is being invalidate because project 4e45f2daf83f49a5b8194803286c1272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:54.935035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.935659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:54.937202 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 969/1943] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:54 2022] DELETE /identity/v3/projects/4e45f2daf83f49a5b8194803286c1272 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:54.941216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:54.950687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf723299-33ea-4c9e-9320-16886b9ed58b service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.007245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.007804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.008074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.008530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] PATH_INFO: `/v3/users/7fe7f1a532ed416394bd28f7b1cb5009` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.009688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe7f1a532ed416394bd28f7b1cb5009)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.011632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.061365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe7f1a532ed416394bd28f7b1cb5009'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.069872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe7f1a532ed416394bd28f7b1cb5009'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.086883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe7f1a532ed416394bd28f7b1cb5009'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.094775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe7f1a532ed416394bd28f7b1cb5009'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.095519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ae7a2a40-ffa5-45dd-9388-96cb68336501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe7f1a532ed416394bd28f7b1cb5009'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.102457 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 975/1944] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:54 2022] DELETE /identity/v3/users/7fe7f1a532ed416394bd28f7b1cb5009 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:55.372825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.374539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:55.389480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ae4f5-06f0-4c07-be04-273db534ee66 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.448829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.449507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.449781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.450045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] PATH_INFO: `/v3/projects/874d845d384e445294c74833054ed1fa` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.451284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=874d845d384e445294c74833054ed1fa)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.453276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.503001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874d845d384e445294c74833054ed1fa', 'request_id': 'req-df3a24fe-1aea-46e1-9761-aebecaf61f8a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.509234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874d845d384e445294c74833054ed1fa', 'request_id': 'req-df3a24fe-1aea-46e1-9761-aebecaf61f8a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.515848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874d845d384e445294c74833054ed1fa', 'request_id': 'req-df3a24fe-1aea-46e1-9761-aebecaf61f8a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.528897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:55.535096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] The token cache is being invalidate because project 874d845d384e445294c74833054ed1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:57:55.535579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.536966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-df3a24fe-1aea-46e1-9761-aebecaf61f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:55.539595 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 970/1945] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:55 2022] DELETE /identity/v3/projects/874d845d384e445294c74833054ed1fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:55.547117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.547577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.547676 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.569294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:55.570515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:55.633917 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 976/1946] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:55.643056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.643466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.643890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.666126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:55.667333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:55.677150 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 971/1947] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:55.681597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.692025 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7aecd7-8892-48e4-8d77-19cddd19db70 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.697663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.698274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.698549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.698824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.699472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:57:55.699759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.701425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.713941 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 977/1948] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 00:57:55.718527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.728723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f30239-71eb-448e-878b-3d17e71f83f0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.734368 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.734963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.735219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.735477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.736096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.738151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.767189 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 972/1949] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:55.771796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.778824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:55.783711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0446aa-9253-41a4-8d84-185d3c80ea7d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.843858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.844487 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.844762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.845060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.845793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.847784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.871094 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 978/1950] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:57:55 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:57:55.875529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.886227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4699c40-7d50-490d-8081-d560ff051cfd admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.892377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.893035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.893333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.893619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.894251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.895844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.906396 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 973/1951] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:55.910529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.921317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb3b3-45f3-452c-a4da-7709fde0a91a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.927077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.927667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.927942 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.928238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.928876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.930515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d5128-87c4-4f54-8687-1d3e82b0e259 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:55.941519 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 979/1952] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:57:55.945652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:55.956177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fac07f-1830-4e27-8f0b-b3592d663d0e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:55.961370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:55.962014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:55.962302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:55.962566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] PATH_INFO: `/v3/projects/139e3df9766c4972bfb55ac48b3c4487/users/ecf9f98343944733883837187d37a0da/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:55.980017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e3df9766c4972bfb55ac48b3c4487, user_id=ecf9f98343944733883837187d37a0da, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:55.982963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:56.002390 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 974/1953] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:57:55 2022] PUT /identity/v3/projects/139e3df9766c4972bfb55ac48b3c4487/users/ecf9f98343944733883837187d37a0da/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:56.012905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:56.013190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:56.013457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:56.041782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] MFA Rules not processed for user `ecf9f98343944733883837187d37a0da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:56.042928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:56.110421 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 980/1954] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:56.121565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:56.123419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:56.181688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996966-d763-487b-9144-22d443aeb242 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:56.185621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:56.186212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:56.186491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:56.187439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:56.196342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:56.197833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871ce32-a8b2-4663-8a68-a7e1949515d8 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:56.207065 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 975/1955] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:59.281077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:59.345284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c71b1d-d466-4961-8eca-806d4e886ac1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:59.350148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:59.350844 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:59.351431 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:59.351702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] PATH_INFO: `/v3/users/ecf9f98343944733883837187d37a0da` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:59.353045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf9f98343944733883837187d37a0da)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:59.355032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:59.369398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:57:59.403017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf9f98343944733883837187d37a0da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:59.411912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf9f98343944733883837187d37a0da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:59.424682 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf9f98343944733883837187d37a0da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:59.431996 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf9f98343944733883837187d37a0da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:59.432628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf9f98343944733883837187d37a0da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:57:59.438946 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 981/1956] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:57:59 2022] DELETE /identity/v3/users/ecf9f98343944733883837187d37a0da => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:57:59.443652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:59.444124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:59.444214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:59.463808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:57:59.465031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:59.528540 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 976/1957] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:57:59.538465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:59.540024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:59.598315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be63e1-fc1f-47dc-a00d-af61ee7e5242 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:59.602548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:59.603151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:59.603424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:59.603666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:59.613366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:59.614794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:57:59.624140 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 982/1958] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:57:59.915437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:57:59.916992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:57:59.938057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70deb1b5-900f-4708-87fb-ce7f9720bd97 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:57:59.968906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:57:59.968906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:57:59.968906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:57:59.968906 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] PATH_INFO: `/v3/projects/139e3df9766c4972bfb55ac48b3c4487` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:57:59.969490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139e3df9766c4972bfb55ac48b3c4487)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:57:59.969490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:00.023444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:00.039174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139e3df9766c4972bfb55ac48b3c4487', 'request_id': 'req-684adf07-76a0-437a-989f-57ac29f72491'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:00.045523 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139e3df9766c4972bfb55ac48b3c4487', 'request_id': 'req-684adf07-76a0-437a-989f-57ac29f72491'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:00.053425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139e3df9766c4972bfb55ac48b3c4487', 'request_id': 'req-684adf07-76a0-437a-989f-57ac29f72491'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:00.069432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] The token cache is being invalidate because project 139e3df9766c4972bfb55ac48b3c4487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:58:00.070486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:00.071150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-684adf07-76a0-437a-989f-57ac29f72491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:00.072887 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 977/1959] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:57:59 2022] DELETE /identity/v3/projects/139e3df9766c4972bfb55ac48b3c4487 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:58:04.704932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:04.706683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:04.720445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0157e7-029f-47af-97cb-e25c3dd3f036 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:04.784417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:04.785199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:04.785532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:04.785864 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] PATH_INFO: `/v3/users/a6342a85ada946de97b3ca37ae043ab9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:04.787044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6342a85ada946de97b3ca37ae043ab9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:04.788999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:04.828454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:04.837563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6342a85ada946de97b3ca37ae043ab9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:04.847421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6342a85ada946de97b3ca37ae043ab9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:04.859530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6342a85ada946de97b3ca37ae043ab9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:04.866285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6342a85ada946de97b3ca37ae043ab9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:04.866907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6342a85ada946de97b3ca37ae043ab9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:04.872804 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 983/1960] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:58:04 2022] DELETE /identity/v3/users/a6342a85ada946de97b3ca37ae043ab9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:58:04.877383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:04.877871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:04.877969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:04.898215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:04.899405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:04.963692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 978/1961] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:04.973677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:04.975313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:05.036003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20779e77-3f92-4d0b-98f0-08b8d96e5963 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.040076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.040682 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.040984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.041247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.051328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.052796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49396a91-d67f-4aa3-b323-c0ae1d41b16e service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.062988 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 984/1962] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:05.338903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.340345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:05.352917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff8359-e12f-45ba-846b-36ab9ee9113e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.359256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.359884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.360155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.360448 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] PATH_INFO: `/v3/projects/64785d2524bb48b8bf74b3d21f298de9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.361778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64785d2524bb48b8bf74b3d21f298de9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.364823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.413434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64785d2524bb48b8bf74b3d21f298de9', 'request_id': 'req-3682d967-1f41-4999-93a9-36d787b8476c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:05.418998 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64785d2524bb48b8bf74b3d21f298de9', 'request_id': 'req-3682d967-1f41-4999-93a9-36d787b8476c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:05.425020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64785d2524bb48b8bf74b3d21f298de9', 'request_id': 'req-3682d967-1f41-4999-93a9-36d787b8476c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:05.439757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] The token cache is being invalidate because project 64785d2524bb48b8bf74b3d21f298de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:58:05.440112 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:05.440772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3682d967-1f41-4999-93a9-36d787b8476c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:05.442303 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 979/1963] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:58:05 2022] DELETE /identity/v3/projects/64785d2524bb48b8bf74b3d21f298de9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:58:05.448192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.448473 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.448739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.468550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:05.470048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:05.530996 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 985/1964] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:05.539157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.539437 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.539706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.560513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:05.561911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:05.570904 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 980/1965] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:05.575348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.586992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09e012-d455-4b79-a1eb-bdc0f3c687f5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.594511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.595286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.595642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.596024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.596783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 00:58:05.597124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.598732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.610990 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 986/1966] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 00:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 00:58:05.615379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.624666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78a2dd-bf7c-4058-a11b-f3129012b3e6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.629725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.630316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.630589 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.630853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.631477 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.633439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.663854 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 981/1967] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 00:58:05 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 00:58:05.668092 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.678732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51b6d2-67f3-4a8c-8771-f7a79cf5e05d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.722520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:05.738975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.739582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.739853 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.740117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.740747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.742704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.765891 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 987/1968] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 00:58:05 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 00:58:05.770169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.780720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e270e5-85d2-4913-b994-2d21f8cc4ed0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.785507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.786099 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.786372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.786632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.787263 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.788871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.802542 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 982/1969] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 00:58:05.803672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.815269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da43ff-424c-4ee6-bc0d-47ff1a107019 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.820549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.821339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.821683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.821965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.822688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.824430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d5580-993e-456c-9d86-6764541de200 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.836036 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 988/1970] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 00:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 00:58:05.840486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:05.850684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d64467-40dd-44d2-85f3-1c4f7ba58ed0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:05.856336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:05.857015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.857348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.857624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] PATH_INFO: `/v3/projects/0d042d5d14c34351a58979811a3f6d93/users/44de711c42e6464fa4758b902257fbc3/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.859993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:05.875556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d042d5d14c34351a58979811a3f6d93, user_id=44de711c42e6464fa4758b902257fbc3, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:05.878324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:05.894371 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 983/1971] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 00:58:05 2022] PUT /identity/v3/projects/0d042d5d14c34351a58979811a3f6d93/users/44de711c42e6464fa4758b902257fbc3/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:58:05.906047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce8e0-85e4-49a4-87d0-d7b771f9b05a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:05.906330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce8e0-85e4-49a4-87d0-d7b771f9b05a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:05.906598 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ce8e0-85e4-49a4-87d0-d7b771f9b05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:05.935503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-415ce8e0-85e4-49a4-87d0-d7b771f9b05a None None] MFA Rules not processed for user `44de711c42e6464fa4758b902257fbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:05.936822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-415ce8e0-85e4-49a4-87d0-d7b771f9b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:06.005033 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 989/1972] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:06.018642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:06.020396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:06.077038 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a039c-5915-44e9-b21d-b7d7d25bba97 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:06.081227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:06.081936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:06.082310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:06.082610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:06.093251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:06.094711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:06.107665 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 984/1973] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:12.442749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b787-fd13-4749-ac4e-0896d89e74db None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:12.443245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b787-fd13-4749-ac4e-0896d89e74db None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:12.443245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b787-fd13-4749-ac4e-0896d89e74db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:12.466176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5938b787-fd13-4749-ac4e-0896d89e74db None None] MFA Rules not processed for user `bb8be65b81ca4eee9a524ddb6577d188`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:12.467420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5938b787-fd13-4749-ac4e-0896d89e74db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:12.537713 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 990/1974] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:16.100432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:22.530081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:43.757191 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:43.827961 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9df1e-3a52-45a8-8abd-b81c59dfff78 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:43.833100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:43.833711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:43.833987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:43.834253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] PATH_INFO: `/v3/users/44de711c42e6464fa4758b902257fbc3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:43.835446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44de711c42e6464fa4758b902257fbc3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:43.837346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:43.891091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44de711c42e6464fa4758b902257fbc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:43.891767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44de711c42e6464fa4758b902257fbc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:43.901108 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44de711c42e6464fa4758b902257fbc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:43.913240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44de711c42e6464fa4758b902257fbc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:43.920255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44de711c42e6464fa4758b902257fbc3'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:43.926178 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 985/1975] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 00:58:43 2022] DELETE /identity/v3/users/44de711c42e6464fa4758b902257fbc3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 00:58:43.931154 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:43.931641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:43.931743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:43.951238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:58:43.952456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:44.015871 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 991/1976] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:58:44.027307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:44.028828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:44.088372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9808-94ef-4230-801f-883787206917 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:44.092514 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:44.093124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:44.093396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:44.093659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:44.103790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:44.105309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd908b3-7b6c-4a40-ab52-bc082e27ed7d service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:44.115461 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 986/1977] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:58:44.385959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:58:44.387400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:58:44.401047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd0142-bb6a-45da-bd54-024aa6df1610 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:58:44.405708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:58:44.406351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:58:44.406626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:58:44.406903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] PATH_INFO: `/v3/projects/0d042d5d14c34351a58979811a3f6d93` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:58:44.408102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d042d5d14c34351a58979811a3f6d93)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:58:44.410024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:58:44.457811 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d042d5d14c34351a58979811a3f6d93', 'request_id': 'req-205b117c-a9bb-41c3-b460-9e0deac1fbc7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:44.463267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d042d5d14c34351a58979811a3f6d93', 'request_id': 'req-205b117c-a9bb-41c3-b460-9e0deac1fbc7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:44.469720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d042d5d14c34351a58979811a3f6d93', 'request_id': 'req-205b117c-a9bb-41c3-b460-9e0deac1fbc7'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:44.483894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] The token cache is being invalidate because project 0d042d5d14c34351a58979811a3f6d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 00:58:44.484172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:44.484798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 00:58:44.486323 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 992/1978] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 00:58:44 2022] DELETE /identity/v3/projects/0d042d5d14c34351a58979811a3f6d93 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 00:58:54.110558 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:58:54.480780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:13.990700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f909eb-b5c1-442e-8abc-d20a940ab642 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:13.991233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f909eb-b5c1-442e-8abc-d20a940ab642 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:13.991233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f909eb-b5c1-442e-8abc-d20a940ab642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:14.011655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-77f909eb-b5c1-442e-8abc-d20a940ab642 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:14.012764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-77f909eb-b5c1-442e-8abc-d20a940ab642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:14.070835 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 987/1979] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:14.113703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:14.115411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:14.198021 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b117c-a9bb-41c3-b460-9e0deac1fbc7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:14.203603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:14.204218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:14.204493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:14.204761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:14.213215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:14.214803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e406d87-ddaf-440b-94d6-e33aecc4bc1f service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:14.222972 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 993/1980] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 00:59:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:59:24.063593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=25 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:24.220067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=32 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:25.907644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1e21a-cc92-48fa-aa36-d0d5c6da4890 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:25.908176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1e21a-cc92-48fa-aa36-d0d5c6da4890 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:25.908176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1e21a-cc92-48fa-aa36-d0d5c6da4890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:25.928403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f4d1e21a-cc92-48fa-aa36-d0d5c6da4890 None None] MFA Rules not processed for user `2da699bb0c51440593b8175d05869203`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:25.929682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f4d1e21a-cc92-48fa-aa36-d0d5c6da4890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:25.988122 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 988/1981] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:27.359038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38181-310c-45ba-abf6-66b28721119c None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:27.359523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38181-310c-45ba-abf6-66b28721119c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:27.359523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38181-310c-45ba-abf6-66b28721119c None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:27.360953 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 994/1982] 10.222.0.13 () {54 vars in 961 bytes} [Sun Oct 16 00:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:59:27.366075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3150-e388-4045-9731-12d99538655c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:27.366511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3150-e388-4045-9731-12d99538655c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:27.366624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3150-e388-4045-9731-12d99538655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:27.387837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-640c3150-e388-4045-9731-12d99538655c None None] MFA Rules not processed for user `410ef41768a448bda827bac4b6ba411b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:27.389156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-640c3150-e388-4045-9731-12d99538655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:27.456339 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 989/1983] 10.222.0.13 () {58 vars in 1058 bytes} [Sun Oct 16 00:59:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:27.464227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38181-310c-45ba-abf6-66b28721119c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:27.479934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38181-310c-45ba-abf6-66b28721119c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:27.485774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:27.486368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:27.486646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:27.486943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:27.489219 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:27.501816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:27.503442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f4562-17f6-4866-bdc8-8396737e8598 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:27.514192 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 995/1984] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:59:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:59:28.740329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:28.740945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:28.741365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:28.742727 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 990/1985] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:59:28.749436 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413d51-5694-4dda-9e03-6280f02def96 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:28.750068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413d51-5694-4dda-9e03-6280f02def96 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:28.750068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d413d51-5694-4dda-9e03-6280f02def96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:28.771194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-9d413d51-5694-4dda-9e03-6280f02def96 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:28.772490 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9d413d51-5694-4dda-9e03-6280f02def96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:28.848311 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 996/1986] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:59:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:28.860613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:28.862372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:28.921533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192b6ec-1f75-41e5-8456-1cbc0c49dee8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:28.925276 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:28.925892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:28.926171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:28.926444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:28.936676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:28.938179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2642bab-b4f7-409d-87a2-321ab8a787b7 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:28.948746 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 991/1987] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:59:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:59:29.019974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.020240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.020521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.022175 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 997/1988] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:59:29.026817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e843-ffa2-4468-8df1-f5382ba18769 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.027120 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e843-ffa2-4468-8df1-f5382ba18769 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.027387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0e843-ffa2-4468-8df1-f5382ba18769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.047766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-41e0e843-ffa2-4468-8df1-f5382ba18769 None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:29.048997 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-41e0e843-ffa2-4468-8df1-f5382ba18769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:29.090206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:29.103747 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 992/1989] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:59:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 00:59:29.116137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:29.118007 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:29.132215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b37a73-e99b-46d6-93f0-a1e6b1d504c5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:29.135837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:29.136439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.136709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.137008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.144071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:29.145543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8df32-0047-45ba-bcd5-d2db864800c1 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:29.153477 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 998/1990] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:59:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:59:29.235804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.236090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.236360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.237791 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 993/1991] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 00:59:29.242746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100eeb-0523-4b68-b714-f6d89185e13d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.243094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100eeb-0523-4b68-b714-f6d89185e13d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.243428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100eeb-0523-4b68-b714-f6d89185e13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.265867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5c100eeb-0523-4b68-b714-f6d89185e13d None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:29.267420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5c100eeb-0523-4b68-b714-f6d89185e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:29.279516 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 999/1992] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 00:59:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:29.291519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:29.293317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:29.307756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7f369-3952-4d9b-a9a2-225786fbc8c6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:29.311990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:29.312812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:29.313193 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:29.313521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:29.326946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:29.328396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:29.340593 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 994/1993] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 00:59:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 00:59:32.362795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b609-1f1b-4d01-bed6-b1ca6da71f7f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:32.363342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b609-1f1b-4d01-bed6-b1ca6da71f7f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:32.363342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b609-1f1b-4d01-bed6-b1ca6da71f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:32.384740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-96f8b609-1f1b-4d01-bed6-b1ca6da71f7f None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:32.386106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-96f8b609-1f1b-4d01-bed6-b1ca6da71f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:32.394435 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1000/1994] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:32.408460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:32.420433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29d95-f7ba-4e19-8b80-0bf010be1442 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:32.425704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:32.426336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:32.426617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:32.426878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:32.436458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:32.439042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:32.448218 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 995/1995] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 00:59:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 00:59:42.379318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=49 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:42.444534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=15 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 00:59:58.196826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f9eb-4ae8-405a-88c1-51c3fa17ab84 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:58.197429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f9eb-4ae8-405a-88c1-51c3fa17ab84 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:58.197429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f9eb-4ae8-405a-88c1-51c3fa17ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:58.218447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18c6f9eb-4ae8-405a-88c1-51c3fa17ab84 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 00:59:58.219776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18c6f9eb-4ae8-405a-88c1-51c3fa17ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 00:59:58.228511 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1001/1996] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 00:59:58.241828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 00:59:58.252130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4011b23-1985-4cd2-ad19-c2b642a24009 service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 00:59:58.257256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 00:59:58.257858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 00:59:58.258129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 00:59:58.258392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 00:59:58.266827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 00:59:58.268511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 00:59:58.276694 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 996/1997] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 00:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:00:08.213062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:08.273775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:00:37.849695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:00:37.850292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:00:37.850292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:00:37.870978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] MFA Rules not processed for user `bb8be65b81ca4eee9a524ddb6577d188`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:00:37.872205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:00:37.931519 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1002/1998] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:00:47.923420 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=25 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:06.191302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:06.193283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:06.258079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4bf0-44cf-41b3-844b-3bfa946f4f2d service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:06.262061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:06.262653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:06.262927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:06.263188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:06.264922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:06.278176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:06.279563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cf92b-5ccc-4a28-811d-1730903089a0 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:06.291804 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 997/1999] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:09.008851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:09.022075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183ef23-c1b2-464e-a03f-922eb78fc8c3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:09.026097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:09.026697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:09.026974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:09.027286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:09.029127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:09.042589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:09.044014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:09.054969 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1003/2000] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:14.442692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:14.443190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:14.443190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:14.462405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] MFA Rules not processed for user `6538a3de44cd4650b31aab5f169a8abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:14.463592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:14.518854 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 998/2001] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:18.568145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:18.569738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.583492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a562e8-09c7-4bb1-8e25-735241558681 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:18.589143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:18.589733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:18.590008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:18.590275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:18.592027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:18.603457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:18.605116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:18.615444 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1004/2002] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:24.511746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=51 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:28.610971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=12 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:01:30.026769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:30.037421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7bc79-49c8-4e00-999a-930b365e8da5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:30.042150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:30.042865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:30.043312 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:30.043651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:30.045663 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:30.057835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:30.059533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0882-0c12-4b51-afc3-148a092d7d40 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:30.068181 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 999/2003] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:01:34.428878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:34.430418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.447922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc7f5-e212-47bf-936f-240dd01acdc9 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:34.453960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:34.454599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:34.454857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:34.455124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:34.457080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:34.472353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:34.474556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:34.487363 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1005/2004] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:38.111270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.111728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.112032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.132279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] MFA Rules not processed for user `2da699bb0c51440593b8175d05869203`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:38.133513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.141332 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1000/2005] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:01:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:38.466914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:38.476969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d001e-4507-43af-9e59-ea6f1b8a2f2c service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:38.481380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:38.481990 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.482263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.482528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.484635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.495950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:38.497412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:38.506548 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1006/2006] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:38.839996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:38.854318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175422de-48de-4de2-87fa-c07d3605ed67 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:38.859835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:38.860438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:38.860711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:38.861025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:38.862849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:38.875528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:38.877161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:38.887320 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1001/2007] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:45.670693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:45.681180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889d8b3-e28f-4f90-aa79-92fecc8cc533 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:45.686106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:45.686712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:45.686983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:45.687242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:45.689004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:45.749830 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:45.751369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c89721-8ccf-4504-9373-bb8c3fa7657a service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:45.765326 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1007/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:48.649279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:01:48.659718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb285f-be47-4afa-8951-9ee3c14ab472 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:01:48.664264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:01:48.664864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:48.665155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:48.665443 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:48.667544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:48.680017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:01:48.681489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:01:48.690717 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1002/2009] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:01:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:01:54.113751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:01:54.114235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:01:54.114366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:01:54.135014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] MFA Rules not processed for user `63527c420b154db4abb6e832e46ccd05`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:01:54.136319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:01:54.144504 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1008/2010] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:01:58.686599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=21 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:04.129111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=43 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:05.898153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:05.913062 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34661f1f-c651-4d51-a4cb-6ab11335f087 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:05.918545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:05.919151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:05.919436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:05.919721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:05.921556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:05.934142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:05.935747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:05.946509 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1003/2011] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:11.265236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:11.276214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05a70-e99c-47d0-85ce-43d46a687cca None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:11.280577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:11.281277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.281541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.281807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.283855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:11.348012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:11.349398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:11.359424 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1009/2012] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:11.550917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:11.562714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060659b7-ed4e-4ee0-9970-e67766c095ce service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:11.569044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:11.569691 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:11.569968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:11.570239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:11.572222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:11.586844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:11.588374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:11.600875 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1004/2013] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:15.149267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.161466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c304-c573-410a-8ab1-f5c96e7b4765 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.167641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.168277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.168531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.168794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.170769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:15.182886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.184607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.194935 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1010/2014] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:15.213109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.214696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:15.228991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17738b-746f-46ae-948a-2b1072bc2ac8 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.233603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.234278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.234551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.234817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] PATH_INFO: `/v3/users/bb8be65b81ca4eee9a524ddb6577d188` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.236040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8be65b81ca4eee9a524ddb6577d188)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.238088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.285407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8be65b81ca4eee9a524ddb6577d188'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.286055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8be65b81ca4eee9a524ddb6577d188'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.294834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8be65b81ca4eee9a524ddb6577d188'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.306577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8be65b81ca4eee9a524ddb6577d188'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.313268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-487c6f04-1883-45bb-b696-8fc914dd540d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8be65b81ca4eee9a524ddb6577d188'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.319040 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1005/2015] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:15 2022] DELETE /identity/v3/users/bb8be65b81ca4eee9a524ddb6577d188 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:15.499763 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.512478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4e1a-303c-4176-8a5c-018700d6c744 service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.569047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.569787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.570059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.570323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] PATH_INFO: `/v3/projects/18cdea5418644c38bdff444de462b7c6` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.571409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cdea5418644c38bdff444de462b7c6)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.573472 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.622654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cdea5418644c38bdff444de462b7c6', 'request_id': 'req-25785bbf-ad45-47e6-851c-74cb6a5a8247'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.628039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cdea5418644c38bdff444de462b7c6', 'request_id': 'req-25785bbf-ad45-47e6-851c-74cb6a5a8247'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.634340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cdea5418644c38bdff444de462b7c6', 'request_id': 'req-25785bbf-ad45-47e6-851c-74cb6a5a8247'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.648702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] The token cache is being invalidate because project 18cdea5418644c38bdff444de462b7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:15.649010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.649600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25785bbf-ad45-47e6-851c-74cb6a5a8247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:15.651073 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1011/2016] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:15 2022] DELETE /identity/v3/projects/18cdea5418644c38bdff444de462b7c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:15.656098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.656384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.656678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.677669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:15.678872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:15.739629 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1006/2017] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:15.747609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.747886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.748155 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.770632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:15.772427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:15.786060 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1012/2018] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:15.790504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.800656 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b18ab-30fb-4012-9352-153a402b053d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.806122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.806716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.806985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.807250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.808018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:15.808313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.809934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.821318 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1007/2019] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:15.825504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.831119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:15.835221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e0e09-a1c6-40cb-a56d-1bbeba46cfac None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.842189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.842800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.843077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.843347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.844056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.846327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.877162 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1013/2020] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:15 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:15.881244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.891446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86787178-3d79-4547-b242-a78090e5d755 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.922645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:15.950127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.950723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.950996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.951265 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.951903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:15.953847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:15.976824 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1008/2021] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:15 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:15.981072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:15.992161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc0ade-256b-4d6e-b9f7-9f2b068033a4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:15.997587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:15.998191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:15.998471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:15.998744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:15.999382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.001089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.011328 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1014/2022] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:16.015095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.025173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07a5ac-05c8-456f-a480-ecaa1360bf9a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.030290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.030904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.031237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.031517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.032202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.033920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c049bf6-a47e-4a08-8cb3-93e4ef05b9e3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.044011 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1009/2023] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:16.048729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.058910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c75ac-2e8e-4f33-9c35-16c6ef39f275 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.063782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.064425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.064697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.064998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] PATH_INFO: `/v3/projects/420813a99d284c9c8f72423bce3ab691/users/7c76035519e0427284b75885532f0b2c/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.079728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] RBAC: Authorizing `identity:create_grant(project_id=420813a99d284c9c8f72423bce3ab691, user_id=7c76035519e0427284b75885532f0b2c, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.082425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.098091 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1015/2024] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:16 2022] PUT /identity/v3/projects/420813a99d284c9c8f72423bce3ab691/users/7c76035519e0427284b75885532f0b2c/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:16.108424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.108709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.109096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.138621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] MFA Rules not processed for user `7c76035519e0427284b75885532f0b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:16.139865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:16.209233 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1010/2025] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:16.213652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.277230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b75ae1-46be-4723-a204-cfca0721963a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.282128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.282722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.282979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.283246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.283863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.285785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.315432 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1016/2026] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:16 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:16.320307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.333887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585013d-262c-49ae-91f3-8dbcd9bdc457 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.389905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.390519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.390783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.391057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.391680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.393644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.420370 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1011/2027] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:16 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:16.424513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.434630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257aad-ff43-4964-8bfc-09c694413e7c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.439544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.440135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.440405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.440672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.441333 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.442943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.453486 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1017/2028] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:16.457771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.468019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcfacf-9624-400c-896b-0939b8a30e41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.473418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.474076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.474339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.474606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] PATH_INFO: `/v3/projects/a602d40137a64d2085a9b872ec2df283/users/3afc3e7434bd4f5783597410761cbe7c/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.489118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a602d40137a64d2085a9b872ec2df283, user_id=3afc3e7434bd4f5783597410761cbe7c, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.491787 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.506205 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1012/2029] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:16 2022] PUT /identity/v3/projects/a602d40137a64d2085a9b872ec2df283/users/3afc3e7434bd4f5783597410761cbe7c/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:16.510161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.520519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8414-29a2-4c26-8b52-ea963c453e1b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.579419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.580026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.580303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.580570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.581232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.582826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2239d-2abb-4d45-a05a-4a263a1ef9c5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.593033 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1018/2030] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:16.597941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.608776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e796-20ab-4e7b-b99d-d9f282216c2a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.613627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.614272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.614547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.614817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] PATH_INFO: `/v3/projects/a602d40137a64d2085a9b872ec2df283/users/3afc3e7434bd4f5783597410761cbe7c/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.616790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a602d40137a64d2085a9b872ec2df283, user_id=3afc3e7434bd4f5783597410761cbe7c, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.619482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.621670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:16.632737 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1013/2031] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:16 2022] PUT /identity/v3/projects/a602d40137a64d2085a9b872ec2df283/users/3afc3e7434bd4f5783597410761cbe7c/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:16.644636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.644816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.645118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.675309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] MFA Rules not processed for user `3afc3e7434bd4f5783597410761cbe7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:16.676525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:16.681870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:16.750133 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1019/2032] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:16.761820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.763724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:16.824255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e06a6-892d-40c4-9a3f-8a00861845b8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.829204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.829809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.830081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.830345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:16.841804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:16.845444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:16.856135 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1014/2033] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:16.935309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:16.945529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362d7c6-e04f-4fa6-98a4-33ea10776b4b None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:16.949845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:16.950446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:16.950719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:16.950983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:17.008781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:17.010249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05ca86-ed13-42b6-97d0-142a5d3561e0 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:17.019541 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1020/2034] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:23.924518 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:23.991030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635f343-7bdf-4a37-bbdd-954c1545824f service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:23.996115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:23.996746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:23.997042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:23.997310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] PATH_INFO: `/v3/users/7c76035519e0427284b75885532f0b2c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:23.998465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c76035519e0427284b75885532f0b2c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:24.000395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:24.047096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c76035519e0427284b75885532f0b2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.047919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c76035519e0427284b75885532f0b2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.056526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c76035519e0427284b75885532f0b2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.068627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c76035519e0427284b75885532f0b2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.075696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c76035519e0427284b75885532f0b2c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.082095 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1015/2035] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:23 2022] DELETE /identity/v3/users/7c76035519e0427284b75885532f0b2c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:24.086845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:24.087255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:24.087449 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:24.108341 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:24.109606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:24.170537 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1021/2036] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:24.180506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:24.182002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:24.200541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:24.241840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f932a-751a-4b27-8b7f-7360b5e8c6bb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:24.245714 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:24.246317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:24.246594 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:24.246865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:24.256717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:24.258270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:24.267838 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1016/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:24.545539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:24.547318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:24.560571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166477a-6e38-4a4a-a2b4-2ee78a7e93d5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:24.565887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:24.566609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:24.566852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:24.567136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] PATH_INFO: `/v3/projects/420813a99d284c9c8f72423bce3ab691` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:24.568406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420813a99d284c9c8f72423bce3ab691)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:24.570353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:24.612281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:24.622242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420813a99d284c9c8f72423bce3ab691', 'request_id': 'req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.627749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420813a99d284c9c8f72423bce3ab691', 'request_id': 'req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.633871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420813a99d284c9c8f72423bce3ab691', 'request_id': 'req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.646878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] The token cache is being invalidate because project 420813a99d284c9c8f72423bce3ab691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:24.647162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.647804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.649381 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1022/2038] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:24 2022] DELETE /identity/v3/projects/420813a99d284c9c8f72423bce3ab691 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:24.653799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:24.663702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6750a-134e-472b-adc0-d5a1b1d8d9e3 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:24.721608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:24.722638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:24.722920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:24.723207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] PATH_INFO: `/v3/users/3afc3e7434bd4f5783597410761cbe7c` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:24.724414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afc3e7434bd4f5783597410761cbe7c)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:24.726511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:24.775600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afc3e7434bd4f5783597410761cbe7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.776259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afc3e7434bd4f5783597410761cbe7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.783989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afc3e7434bd4f5783597410761cbe7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.795825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afc3e7434bd4f5783597410761cbe7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.802639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-29426eb8-e007-4337-9771-5329cb7dbcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afc3e7434bd4f5783597410761cbe7c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:24.808901 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1017/2039] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:24 2022] DELETE /identity/v3/users/3afc3e7434bd4f5783597410761cbe7c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:25.101051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.102796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:25.116560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b1aa-101f-4e7d-aaa9-ff8337dd4856 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.177489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.178051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.178328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.178627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] PATH_INFO: `/v3/projects/a602d40137a64d2085a9b872ec2df283` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.179808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a602d40137a64d2085a9b872ec2df283)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.181815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.230981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a602d40137a64d2085a9b872ec2df283', 'request_id': 'req-e699d48d-393e-418d-a487-79732e9cf662'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:25.236653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a602d40137a64d2085a9b872ec2df283', 'request_id': 'req-e699d48d-393e-418d-a487-79732e9cf662'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:25.243221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a602d40137a64d2085a9b872ec2df283', 'request_id': 'req-e699d48d-393e-418d-a487-79732e9cf662'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:25.257286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] The token cache is being invalidate because project a602d40137a64d2085a9b872ec2df283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:25.257556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:25.258178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e699d48d-393e-418d-a487-79732e9cf662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:25.259704 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1023/2040] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:25 2022] DELETE /identity/v3/projects/a602d40137a64d2085a9b872ec2df283 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:25.264809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.265495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.265495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.285727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:25.286956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:25.320630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:25.350749 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1018/2041] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:25.359141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.359463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.359735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.380716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:25.382003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:25.390745 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1024/2042] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:25.395288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.405383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c23e61-1f03-4bbc-a423-64aaffa744f6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.410928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.411525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.411802 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.412067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.412709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:25.413067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.414689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.427382 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1019/2043] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:25.431882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.441691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601a4bc-2979-4f3f-b846-490424398a74 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.447024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.447614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.447884 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.448128 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.448751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.450738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.480555 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1025/2044] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:25.484962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.495553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ebd66-7316-440d-ace6-6d917674d8bc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.553374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.554016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.554291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.554563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.555230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.557207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.580914 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1020/2045] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:25.586756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.597880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81e83b-0e07-45f3-afcf-f1d765317b36 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.602453 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.603040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.603309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.603570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.604226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.605874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.615961 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1026/2046] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:25.620199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.631182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b211b9-0a35-4fcf-86dd-7cdde18f5873 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.637070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.637665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.637936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.638197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.638871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.640470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feed1a4-c77d-4f63-91df-29d676537e57 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.652361 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1021/2047] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:25.656800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.667021 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c42a1-82d8-48f1-aa6a-44e5c978dfc7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.672271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.673522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.673522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.673725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] PATH_INFO: `/v3/projects/bcc6cbdea23f4f63809f3fd3e7a6de99/users/cc7373c23bb847ada5384000b24ac94f/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.687599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:25.691080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc6cbdea23f4f63809f3fd3e7a6de99, user_id=cc7373c23bb847ada5384000b24ac94f, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.694537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.708560 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1027/2048] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:25 2022] PUT /identity/v3/projects/bcc6cbdea23f4f63809f3fd3e7a6de99/users/cc7373c23bb847ada5384000b24ac94f/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:25.720510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.720794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.721100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.749810 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] MFA Rules not processed for user `cc7373c23bb847ada5384000b24ac94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:25.751042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:25.815954 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1022/2049] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:25.820534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.884936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2e877-3477-45d9-a230-afaccf4eaa53 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.890078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.890666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.890936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.891200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.891814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:25.893745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:25.926580 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1028/2050] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:25.930858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:25.941753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6a575-c153-45db-90fa-9279ae38b876 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:25.971195 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:25.997473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:25.998076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:25.998352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:25.998600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:25.999220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.001224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.025465 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1023/2051] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:25 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:26.031900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.047856 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d26809-bf92-4f4c-a305-d8658178662b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.053706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.054300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.054582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.054849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.055492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.057145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.067972 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1029/2052] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:26.072243 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.083342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93226ae-9b31-44e4-a613-090266ae3727 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.088217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.088887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.089167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.089438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] PATH_INFO: `/v3/projects/58ac9033c125426fb64ef53a6401c4ca/users/efce506ecfd9424bbd52ea58b575e629/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.106078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ac9033c125426fb64ef53a6401c4ca, user_id=efce506ecfd9424bbd52ea58b575e629, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.108919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.124612 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1024/2053] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:26 2022] PUT /identity/v3/projects/58ac9033c125426fb64ef53a6401c4ca/users/efce506ecfd9424bbd52ea58b575e629/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:26.129230 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.140351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06099a9-61f9-45aa-bc52-166813b91026 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.198532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.199054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.199332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.199598 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.200224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.201859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190b706-15b8-4e42-8c57-d9d190a1e0c3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.211718 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1030/2054] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:26.216955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.233403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce277c8-c133-434b-a73b-59442e0bc9ac admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.239035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.239670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.239939 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.240206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] PATH_INFO: `/v3/projects/58ac9033c125426fb64ef53a6401c4ca/users/efce506ecfd9424bbd52ea58b575e629/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.242256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ac9033c125426fb64ef53a6401c4ca, user_id=efce506ecfd9424bbd52ea58b575e629, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.244872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.255404 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1025/2055] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:26 2022] PUT /identity/v3/projects/58ac9033c125426fb64ef53a6401c4ca/users/efce506ecfd9424bbd52ea58b575e629/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:26.266070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.266350 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.266614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.297821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] MFA Rules not processed for user `efce506ecfd9424bbd52ea58b575e629`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:26.299737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:26.353446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:26.376364 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1031/2056] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:26.388828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.390781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:26.452021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4718-ca26-4f23-bcce-e6cb3c28b69c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.456129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.456721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.457023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.457285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.466739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.468219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a177cf-14df-499c-b628-9eaed3806410 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:26.478184 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1026/2057] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:26.920882 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:26.988238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21453c2-a900-40fd-b705-cd932d1fd062 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:26.993274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:26.993894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:26.994165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:26.994430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] PATH_INFO: `/v3/users/cc7373c23bb847ada5384000b24ac94f` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:26.995588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7373c23bb847ada5384000b24ac94f)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:26.997558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:27.045325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7373c23bb847ada5384000b24ac94f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.054242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7373c23bb847ada5384000b24ac94f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.067193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7373c23bb847ada5384000b24ac94f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.077552 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7373c23bb847ada5384000b24ac94f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.078293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7373c23bb847ada5384000b24ac94f'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.084600 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1032/2058] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:26 2022] DELETE /identity/v3/users/cc7373c23bb847ada5384000b24ac94f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:27.089332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:27.089607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:27.089870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:27.109719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:27.110896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:27.177214 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1027/2059] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:27.187352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:27.188862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:27.248326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8937-47ac-46d5-bb59-d1fbc63ec023 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:27.252338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:27.252972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:27.253248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:27.253517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:27.262760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:27.264183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:27.273816 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1033/2060] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:27.555932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:27.558309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:27.571222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd158832-f104-4a91-b7fb-f8af5adde083 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:27.577097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:27.577815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:27.578064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:27.578327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] PATH_INFO: `/v3/projects/bcc6cbdea23f4f63809f3fd3e7a6de99` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:27.579612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc6cbdea23f4f63809f3fd3e7a6de99)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:27.581704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:27.608029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:27.634892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc6cbdea23f4f63809f3fd3e7a6de99', 'request_id': 'req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.640529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc6cbdea23f4f63809f3fd3e7a6de99', 'request_id': 'req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.646701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc6cbdea23f4f63809f3fd3e7a6de99', 'request_id': 'req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.661610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] The token cache is being invalidate because project bcc6cbdea23f4f63809f3fd3e7a6de99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:27.661889 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.662539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.664075 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1028/2061] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:27 2022] DELETE /identity/v3/projects/bcc6cbdea23f4f63809f3fd3e7a6de99 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:27.668120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:27.677973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dececf54-b35c-4d95-b299-a23023f1c99c service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:27.682628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:27.736010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:27.736639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:27.736941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:27.737212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] PATH_INFO: `/v3/users/efce506ecfd9424bbd52ea58b575e629` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:27.738357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=efce506ecfd9424bbd52ea58b575e629)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:27.740284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:27.789648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efce506ecfd9424bbd52ea58b575e629'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.798827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efce506ecfd9424bbd52ea58b575e629'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.810313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efce506ecfd9424bbd52ea58b575e629'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.817056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efce506ecfd9424bbd52ea58b575e629'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.817671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ecb53457-5002-4709-808f-0d891e619ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efce506ecfd9424bbd52ea58b575e629'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:27.823324 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1034/2062] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:27 2022] DELETE /identity/v3/users/efce506ecfd9424bbd52ea58b575e629 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:28.090611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.092242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:28.106297 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa22a3-8aea-4f15-bfde-5f58f73ad341 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.165045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.165659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.165931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.166199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] PATH_INFO: `/v3/projects/58ac9033c125426fb64ef53a6401c4ca` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.167461 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ac9033c125426fb64ef53a6401c4ca)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.169517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.219498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ac9033c125426fb64ef53a6401c4ca', 'request_id': 'req-70071df2-a578-42e6-9d98-19efad2dd115'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:28.225433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ac9033c125426fb64ef53a6401c4ca', 'request_id': 'req-70071df2-a578-42e6-9d98-19efad2dd115'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:28.231897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ac9033c125426fb64ef53a6401c4ca', 'request_id': 'req-70071df2-a578-42e6-9d98-19efad2dd115'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:28.245509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] The token cache is being invalidate because project 58ac9033c125426fb64ef53a6401c4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:28.245792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:28.246406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-70071df2-a578-42e6-9d98-19efad2dd115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:28.247874 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1029/2063] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:28 2022] DELETE /identity/v3/projects/58ac9033c125426fb64ef53a6401c4ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:28.252893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.253370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.253499 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.273535 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:28.274765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:28.340092 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1035/2064] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:28.348712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.349041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.349319 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.370598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:28.371792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:28.381413 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1030/2065] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:28.385707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.396086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e34bc-5f55-4889-9c58-240a806da2c6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.401751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.402369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.402645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.402914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.403602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:28.403899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.405713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.418025 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1036/2066] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:28.422499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.431825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d510ff-6eef-4ec8-a171-d86eba78b854 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.437121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.437709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.437982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.438246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.438867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.440766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.471497 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1031/2067] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:28.476404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.487122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9dc9c-cb53-48e0-98df-5227ceb90883 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.499246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:28.546331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.546930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.547203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.547467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.548088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.550066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.571506 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1037/2068] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:28.575725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.586395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b59fe-37a0-4f52-b8a3-ec12b2c01675 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.592321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.592890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.593248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.593506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.594209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.595914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.607296 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1032/2069] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:28.611584 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.622063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652e4df-920f-4e65-a012-f4ec92bb0100 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.626976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.627565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.627836 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.628072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.628704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.630324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36390bf7-a103-4b3b-a68d-1042eec666f8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.640863 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1038/2070] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:28.644866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.650058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:28.655896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660dae-7b5b-4659-b830-6ed5f9ff6a9a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.662094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.662988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.663421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.663735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] PATH_INFO: `/v3/projects/cbb3c864a32a462b96b35bdb753a5d34/users/9bdfe63c19154534a4124f595b80fffa/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.678331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb3c864a32a462b96b35bdb753a5d34, user_id=9bdfe63c19154534a4124f595b80fffa, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.681073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.695426 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1033/2071] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:28 2022] PUT /identity/v3/projects/cbb3c864a32a462b96b35bdb753a5d34/users/9bdfe63c19154534a4124f595b80fffa/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:28.708290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.708593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.708904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.738179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] MFA Rules not processed for user `9bdfe63c19154534a4124f595b80fffa`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:28.739444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:28.805752 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1039/2072] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:28.810489 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.872517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349a132-5a2b-4151-a3af-1b3e200302b9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.878121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.878715 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.878986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.879250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.879876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.881856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:28.911829 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1034/2073] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:28.915985 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:28.927426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d60bd-c17e-4224-8359-22b29f847a99 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:28.989374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:28.989973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:28.990247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:28.990517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:28.991142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:28.993115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.017673 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1040/2074] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:28 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:29.022201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.033046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985d03f-e170-4192-a9de-2b530165170a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.038198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.038821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.039097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.039362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.040003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.041657 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.053553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1035/2075] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:29.057880 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.068138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af11068-d942-4b16-8312-f2633af09056 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.073115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.073755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.073995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.074261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] PATH_INFO: `/v3/projects/fc1653a9fe85466bbb954443d03ebdd8/users/ddb67f3dfc7b43428216a5b09ff7b0ef/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.085933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:29.092299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1653a9fe85466bbb954443d03ebdd8, user_id=ddb67f3dfc7b43428216a5b09ff7b0ef, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.095378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.109577 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1041/2076] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:29 2022] PUT /identity/v3/projects/fc1653a9fe85466bbb954443d03ebdd8/users/ddb67f3dfc7b43428216a5b09ff7b0ef/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:29.113627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.123721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b78f3-25a6-46c2-9549-96fef2a67743 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.187402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.188009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.188289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.188556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.189227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.190840 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb85c0-6ded-443c-8b75-17ca6298606f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.200593 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1036/2077] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:29.205043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.215847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0263106-fe2a-4816-bbe8-f205ce6328dd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.221147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.222167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.222450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.222818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] PATH_INFO: `/v3/projects/fc1653a9fe85466bbb954443d03ebdd8/users/ddb67f3dfc7b43428216a5b09ff7b0ef/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.224872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1653a9fe85466bbb954443d03ebdd8, user_id=ddb67f3dfc7b43428216a5b09ff7b0ef, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.227753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.238815 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1042/2078] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:29 2022] PUT /identity/v3/projects/fc1653a9fe85466bbb954443d03ebdd8/users/ddb67f3dfc7b43428216a5b09ff7b0ef/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:29.248988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.249279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.249553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.279831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] MFA Rules not processed for user `ddb67f3dfc7b43428216a5b09ff7b0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:29.281080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:29.321066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:29.353912 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1037/2079] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:29.365896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.367904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:29.430049 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d4bdc-a11c-4ee0-87dd-0f61ac6dba1d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.434067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.434661 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.434935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.435199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.444417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.445889 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.455192 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1043/2080] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:29.536602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:29.547869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad144089-ebcd-4648-bedd-05f9a78973e0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:29.552551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:29.553184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:29.553457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:29.553725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:29.611335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:29.612955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228af42-ac06-40ee-8377-4885cde9101a service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:29.622191 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1038/2081] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:32.382038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:32.443187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d892cdc-58d5-4293-b630-8bed45b3ac32 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:32.448031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:32.448648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:32.448949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:32.449220 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] PATH_INFO: `/v3/users/9bdfe63c19154534a4124f595b80fffa` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:32.450365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdfe63c19154534a4124f595b80fffa)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:32.452280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:32.503404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdfe63c19154534a4124f595b80fffa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:32.510623 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdfe63c19154534a4124f595b80fffa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:32.522342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdfe63c19154534a4124f595b80fffa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:32.529113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdfe63c19154534a4124f595b80fffa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:32.529727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdfe63c19154534a4124f595b80fffa'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:32.531162 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:32.537632 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1044/2082] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:32 2022] DELETE /identity/v3/users/9bdfe63c19154534a4124f595b80fffa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:32.542458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:32.542950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:32.542950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:32.562766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:32.563987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:32.624784 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1039/2083] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:32.635398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:32.637425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:32.694787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b4cab-1ced-43fd-8456-abcdf6a1d517 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:32.698817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:32.699409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:32.699680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:32.699941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:32.709335 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:32.710752 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:32.720595 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1045/2084] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:33.010828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.012406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:33.024758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79074206-eaff-4db6-84b7-71fc457b0aeb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:33.030572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:33.031430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.031871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.032142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] PATH_INFO: `/v3/projects/cbb3c864a32a462b96b35bdb753a5d34` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.033545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb3c864a32a462b96b35bdb753a5d34)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:33.035620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:33.083372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb3c864a32a462b96b35bdb753a5d34', 'request_id': 'req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.091273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb3c864a32a462b96b35bdb753a5d34', 'request_id': 'req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.098441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb3c864a32a462b96b35bdb753a5d34', 'request_id': 'req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.102317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:33.113978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] The token cache is being invalidate because project cbb3c864a32a462b96b35bdb753a5d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:33.114267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.114916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.116489 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1040/2085] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:33 2022] DELETE /identity/v3/projects/cbb3c864a32a462b96b35bdb753a5d34 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:33.120561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.130772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99e395-a2ce-45be-b719-92b3194c9be2 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:33.188814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:33.189464 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.189741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.190011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] PATH_INFO: `/v3/users/ddb67f3dfc7b43428216a5b09ff7b0ef` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.191120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb67f3dfc7b43428216a5b09ff7b0ef)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:33.193098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:33.241796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb67f3dfc7b43428216a5b09ff7b0ef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.251798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb67f3dfc7b43428216a5b09ff7b0ef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.265095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb67f3dfc7b43428216a5b09ff7b0ef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.272659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb67f3dfc7b43428216a5b09ff7b0ef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.273345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-2574a339-1246-4fa0-abf6-c5dcc4d717ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb67f3dfc7b43428216a5b09ff7b0ef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.279224 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1046/2086] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:33 2022] DELETE /identity/v3/users/ddb67f3dfc7b43428216a5b09ff7b0ef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:33.553925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.555396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:33.568629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bc943-3cce-49b3-b0e0-7b0c18a5a26d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:33.626632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:33.627256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.627504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.627772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] PATH_INFO: `/v3/projects/fc1653a9fe85466bbb954443d03ebdd8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.629018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1653a9fe85466bbb954443d03ebdd8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:33.630935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:33.679482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1653a9fe85466bbb954443d03ebdd8', 'request_id': 'req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.684805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1653a9fe85466bbb954443d03ebdd8', 'request_id': 'req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.690984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1653a9fe85466bbb954443d03ebdd8', 'request_id': 'req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.703450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] The token cache is being invalidate because project fc1653a9fe85466bbb954443d03ebdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:33.703731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.704362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b87c5a79-90c4-409f-8a89-f2c7ffce3f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:33.705880 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1041/2087] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:33 2022] DELETE /identity/v3/projects/fc1653a9fe85466bbb954443d03ebdd8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:33.711207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.711667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.711779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.732394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:33.733790 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:33.747364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:33.795951 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1047/2088] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:33.805236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.805516 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.805784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.825805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:33.826984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:33.835148 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1042/2089] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:33.839648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.851107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82ab49-a176-4d3f-9f4e-a2fe7041ed80 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:33.859313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:33.860188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.860589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.860957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.861951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:33.862402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:33.865005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:33.882090 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1048/2090] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:33.887051 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.897987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ce234-e394-4a22-8a47-08a80dcb5248 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:33.903173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:33.903771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:33.904041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:33.904307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:33.904959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:33.906935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:33.936110 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1043/2091] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:33 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:33.940548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:33.950999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe948f0b-8174-4562-a02e-27572150277f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.011059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.011647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.011919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.012206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.012845 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.014793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.037500 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1049/2092] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:33 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:34.042211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.054035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318cdb3-481f-4e58-b2f5-351f1f6faf25 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.059503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.060115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.060391 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.060665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.061414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.063126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.073583 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1044/2093] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:34.077599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.088114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21f16a-c998-49ee-8ab4-03964cd8987b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.093895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.094494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.094765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.095044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.095663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.097608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b7cb3-f44f-4488-8767-a6fa4c388754 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.108813 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1050/2094] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:34.113553 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.124722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ffe3-ea05-47ab-9b71-297783585696 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.130402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.131090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.131357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.131623 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] PATH_INFO: `/v3/projects/907a5ba038fe4a69ba9153c6e70b1575/users/2408baeafc5b4d35aa6cabaaede3e449/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.147651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907a5ba038fe4a69ba9153c6e70b1575, user_id=2408baeafc5b4d35aa6cabaaede3e449, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.150348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.165184 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1045/2095] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:34 2022] PUT /identity/v3/projects/907a5ba038fe4a69ba9153c6e70b1575/users/2408baeafc5b4d35aa6cabaaede3e449/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:34.175935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.176212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.176477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.204103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] MFA Rules not processed for user `2408baeafc5b4d35aa6cabaaede3e449`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:34.205324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:34.282081 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1051/2096] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:34.286899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.312967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:34.360021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d42e7b-f616-42e5-84ff-e779bb14a1e1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.365795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.366458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.366738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.367003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.367632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.369621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.398671 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1046/2097] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:34 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:34.403261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.413948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42dde7-ee12-4d71-9ae0-7e1e3be4d4fa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.425773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:34.472968 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.473575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.473849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.474115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.474741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.476663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.502232 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1052/2098] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:34 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:34.506729 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.518345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee947a1-2322-43b8-93f2-89559f4f385b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.524367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.525016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.525296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.525563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.526259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.527876 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.538921 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1047/2099] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:34.543235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.553700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95454e8e-066c-461e-bd6d-fc41cbccfcd5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.560306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.561261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.561640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.561918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] PATH_INFO: `/v3/projects/ce688d033698433d877d5f3198d633ae/users/490060aa6cdd475b97131e2657f02c4a/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.578826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce688d033698433d877d5f3198d633ae, user_id=490060aa6cdd475b97131e2657f02c4a, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.581560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.597340 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1053/2100] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:34 2022] PUT /identity/v3/projects/ce688d033698433d877d5f3198d633ae/users/490060aa6cdd475b97131e2657f02c4a/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:34.601332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.612110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afccd0c-1e1e-449d-a4ea-265b49b355e6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.681155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.681753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.682024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.682288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.682925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.684510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d64fd-e477-4dcf-bfcb-b554af1d897a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.694486 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1048/2101] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:34.698903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.709562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490899aa-40ef-48ab-9c7c-92dda425836c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.714800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.715416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.715714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.715976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] PATH_INFO: `/v3/projects/ce688d033698433d877d5f3198d633ae/users/490060aa6cdd475b97131e2657f02c4a/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.718102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce688d033698433d877d5f3198d633ae, user_id=490060aa6cdd475b97131e2657f02c4a, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.720731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:34.731882 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1054/2102] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:34 2022] PUT /identity/v3/projects/ce688d033698433d877d5f3198d633ae/users/490060aa6cdd475b97131e2657f02c4a/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:34.742690 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.742978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.743251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.774529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] MFA Rules not processed for user `490060aa6cdd475b97131e2657f02c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:34.775823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:34.851139 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1049/2103] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:34.865414 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:34.867518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:34.927058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cbd4d-a4ce-4ff2-b7e2-79284897791c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:34.931502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:34.932105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:34.932379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:34.932639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:34.989517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:34.990986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:35.000227 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1055/2104] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:37.621879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:37.632648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0f63b-fae9-4e5c-8f01-7c15eb7089a5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:37.636805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:37.637418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:37.637687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:37.637945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:37.647499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:37.648956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b356e-ba2b-4763-aad9-15901a231756 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:37.658735 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1050/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:44.996077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:47.654337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:50.360479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.426791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e0218-a0da-4bc7-bb04-9561d477d7c9 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.432612 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.433309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.433583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.433871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] PATH_INFO: `/v3/users/2408baeafc5b4d35aa6cabaaede3e449` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.435190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2408baeafc5b4d35aa6cabaaede3e449)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.437198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.492788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2408baeafc5b4d35aa6cabaaede3e449'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:50.502883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2408baeafc5b4d35aa6cabaaede3e449'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:50.514813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2408baeafc5b4d35aa6cabaaede3e449'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:50.521727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2408baeafc5b4d35aa6cabaaede3e449'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:50.522369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2408baeafc5b4d35aa6cabaaede3e449'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:50.528165 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1056/2106] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:50 2022] DELETE /identity/v3/users/2408baeafc5b4d35aa6cabaaede3e449 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:50.532982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.533469 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.533570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.553488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:50.554772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:50.614723 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1051/2107] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:50.624465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.625999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:50.682781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a16047-6f29-4597-b701-d462e49e66de admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:50.686484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:50.687091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:50.687366 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:50.687631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:50.696674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:50.698124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:50.707658 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1057/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:50.981629 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:50.983115 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:50.996305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c2934-8b33-4ffe-a251-2fce2e50dfed None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.001768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.002400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.002677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.003581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] PATH_INFO: `/v3/projects/907a5ba038fe4a69ba9153c6e70b1575` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.004922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=907a5ba038fe4a69ba9153c6e70b1575)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.007050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.062644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907a5ba038fe4a69ba9153c6e70b1575', 'request_id': 'req-db301946-5bf8-4d86-95ff-a81ff432e010'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.068394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907a5ba038fe4a69ba9153c6e70b1575', 'request_id': 'req-db301946-5bf8-4d86-95ff-a81ff432e010'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.074716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907a5ba038fe4a69ba9153c6e70b1575', 'request_id': 'req-db301946-5bf8-4d86-95ff-a81ff432e010'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.089506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] The token cache is being invalidate because project 907a5ba038fe4a69ba9153c6e70b1575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:51.089799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.090415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.091938 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1052/2109] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:50 2022] DELETE /identity/v3/projects/907a5ba038fe4a69ba9153c6e70b1575 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:51.096096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.106440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466925bc-7485-4d61-9d49-9e94960da53a service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.126126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:51.166739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.167277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.167524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.167786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] PATH_INFO: `/v3/users/490060aa6cdd475b97131e2657f02c4a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.169002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=490060aa6cdd475b97131e2657f02c4a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.170921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.219686 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490060aa6cdd475b97131e2657f02c4a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.228778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490060aa6cdd475b97131e2657f02c4a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.240561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490060aa6cdd475b97131e2657f02c4a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.247488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490060aa6cdd475b97131e2657f02c4a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.248127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-c4fc37f4-a5c6-46c9-bea4-22c17617cabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490060aa6cdd475b97131e2657f02c4a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.254271 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1058/2110] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:51 2022] DELETE /identity/v3/users/490060aa6cdd475b97131e2657f02c4a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:51.525385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.526832 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.539598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db301946-5bf8-4d86-95ff-a81ff432e010 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.598024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.598649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.598922 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.599186 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] PATH_INFO: `/v3/projects/ce688d033698433d877d5f3198d633ae` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.600326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce688d033698433d877d5f3198d633ae)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.602277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.635141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:51.653163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce688d033698433d877d5f3198d633ae', 'request_id': 'req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.658723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce688d033698433d877d5f3198d633ae', 'request_id': 'req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.665087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce688d033698433d877d5f3198d633ae', 'request_id': 'req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.680074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] The token cache is being invalidate because project ce688d033698433d877d5f3198d633ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:51.680343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.681067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-5df1bd1f-5da2-4d4a-86b0-be49dafb636f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:51.682655 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1053/2111] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:51 2022] DELETE /identity/v3/projects/ce688d033698433d877d5f3198d633ae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:51.687776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.688280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.688380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.709481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:51.710600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.775207 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1059/2112] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:51.783549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.783830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.784098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.803973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:51.805204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:51.813569 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1054/2113] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:51.817984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.828114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2c62-7e48-405b-8cb2-309c2ec12500 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.832346 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.833104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.833377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.833643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.834286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:51.834603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.836200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.848135 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1060/2114] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:02:51.852857 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.862814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0becd-a9bd-4a73-bb53-d46619b22c6d None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.867379 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.868035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.868376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.868638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.869297 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.871364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:51.904295 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1055/2115] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:51.905554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:51.915641 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adc9d8-fccb-4784-95dc-5426dde739e5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:51.941947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:51.975989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:51.976522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:51.976795 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:51.977094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:51.977709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:51.979627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.001834 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1061/2116] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:51 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:52.006492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.018013 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa20eb-1a19-429d-96af-abe2c124bbf3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.023796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.024383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.024652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.024950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.025574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.027177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.037152 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1056/2117] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:52.042250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.052826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081958b-8c30-4d50-abce-6f70439558ea admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.058668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.059269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.059541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.059805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.060440 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.062080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed73cc-e007-4760-aa60-5714c7c7d003 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.073393 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1062/2118] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:52.077459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.087836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c4467-36da-4c67-bdcb-b5f3f518b4ac admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.093316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.093968 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.094341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.094614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] PATH_INFO: `/v3/projects/02676beceefc41b2b9611babd929e162/users/149d31b754014a87b8412c46f17e83b1/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.110260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02676beceefc41b2b9611babd929e162, user_id=149d31b754014a87b8412c46f17e83b1, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.113076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.127637 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1057/2119] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:52 2022] PUT /identity/v3/projects/02676beceefc41b2b9611babd929e162/users/149d31b754014a87b8412c46f17e83b1/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:52.138410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.138701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.138969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.168666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] MFA Rules not processed for user `149d31b754014a87b8412c46f17e83b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:52.169922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:52.236785 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1063/2120] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:52.241445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.305126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957c79-4265-40f0-af87-6596063eaa83 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.310374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.310974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.311245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.311497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.312124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.314074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.343511 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1058/2121] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:52 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:52.347971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.359167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311eab-5ad5-43e5-b5c6-25148cff7ec4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.418102 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.418698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.418973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.419237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.419863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.421813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.445313 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1064/2122] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:52 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:02:52.449633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.460140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31078f-31b7-433e-b980-886da3d11c35 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.465081 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.465669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.465944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.466212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.466852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.468503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.480908 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1059/2123] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:52.486329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.501513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f07fe-2cab-482b-ab8e-89650ed02367 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.507258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.507914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.508192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.508459 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] PATH_INFO: `/v3/projects/3a06a9637d094eebb1227db8e672258c/users/18b137aab1de4ec780455ee78e87f3a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.524429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a06a9637d094eebb1227db8e672258c, user_id=18b137aab1de4ec780455ee78e87f3a2, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.527218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.541717 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1065/2124] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:52 2022] PUT /identity/v3/projects/3a06a9637d094eebb1227db8e672258c/users/18b137aab1de4ec780455ee78e87f3a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:52.546321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.561895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1535bce-bd82-4538-8abd-f64a7a150a80 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.583836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:52.624114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.624717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.625023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.625692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.626339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.627985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbdbb3-51e7-4bc5-92d4-00456d3bc3fa admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.637553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1060/2125] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:52.641953 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.647769 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:52.654483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36eab2-549c-4930-abec-fb1ec35dc256 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.660597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.661315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.661592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.661854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] PATH_INFO: `/v3/projects/3a06a9637d094eebb1227db8e672258c/users/18b137aab1de4ec780455ee78e87f3a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.663974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a06a9637d094eebb1227db8e672258c, user_id=18b137aab1de4ec780455ee78e87f3a2, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.666693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.677972 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1066/2126] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:52 2022] PUT /identity/v3/projects/3a06a9637d094eebb1227db8e672258c/users/18b137aab1de4ec780455ee78e87f3a2/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:52.745962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.746232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.746651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.779467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] MFA Rules not processed for user `18b137aab1de4ec780455ee78e87f3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:52.780667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:52.851903 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1061/2127] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:52.863283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:52.865060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:52.925557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab34068-6759-4807-ac25-69c991816972 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:52.930432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:52.931043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:52.931314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:52.931574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:52.941426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:52.942866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e07ab-b6de-4785-9696-0758741133db service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:52.952557 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1067/2128] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:53.341259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:53.407087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46716271-d034-42f1-9502-a6d07b1df718 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:53.412215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:53.412860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:53.413152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:53.413390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] PATH_INFO: `/v3/users/149d31b754014a87b8412c46f17e83b1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:53.414590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149d31b754014a87b8412c46f17e83b1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:53.416530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:53.463681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149d31b754014a87b8412c46f17e83b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.464332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149d31b754014a87b8412c46f17e83b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.466035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:53.473613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149d31b754014a87b8412c46f17e83b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.485846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149d31b754014a87b8412c46f17e83b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.492964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149d31b754014a87b8412c46f17e83b1'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:53.498859 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1062/2129] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:53 2022] DELETE /identity/v3/users/149d31b754014a87b8412c46f17e83b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:53.503524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:53.503808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:53.504073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:53.522723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:53.523939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:53.593395 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1068/2130] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:53.603811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:53.605534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:53.667758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991c204-3e2d-4eea-b7b0-3855fa6e6252 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:53.674074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:53.674676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:53.674973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:53.675237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:53.685471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:53.686995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:53.697001 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1063/2131] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:53.978506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:53.979991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:53.992802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4750cc-fef0-4e79-b4cf-65995504b51e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:53.998434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:53.999081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:53.999443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:53.999714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] PATH_INFO: `/v3/projects/02676beceefc41b2b9611babd929e162` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.001026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02676beceefc41b2b9611babd929e162)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.002962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:54.058814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02676beceefc41b2b9611babd929e162', 'request_id': 'req-5a1ae505-ea96-4002-a80e-f96b76ca1071'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.065048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02676beceefc41b2b9611babd929e162', 'request_id': 'req-5a1ae505-ea96-4002-a80e-f96b76ca1071'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.071726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02676beceefc41b2b9611babd929e162', 'request_id': 'req-5a1ae505-ea96-4002-a80e-f96b76ca1071'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.086062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] The token cache is being invalidate because project 02676beceefc41b2b9611babd929e162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:54.086351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.086980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.088488 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1069/2132] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:53 2022] DELETE /identity/v3/projects/02676beceefc41b2b9611babd929e162 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:54.092764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.103337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef23e29-f616-4e62-b7a0-f35864b60af3 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:54.162201 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:54.162841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.163114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.163377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] PATH_INFO: `/v3/users/18b137aab1de4ec780455ee78e87f3a2` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.164561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b137aab1de4ec780455ee78e87f3a2)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.166517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:54.216962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b137aab1de4ec780455ee78e87f3a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.217722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b137aab1de4ec780455ee78e87f3a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.226973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b137aab1de4ec780455ee78e87f3a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.238395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:54.239846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b137aab1de4ec780455ee78e87f3a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.248183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-3e7f16bb-8cfe-46c2-9df3-8d15a3dc438c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b137aab1de4ec780455ee78e87f3a2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.254467 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1064/2133] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:54 2022] DELETE /identity/v3/users/18b137aab1de4ec780455ee78e87f3a2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:54.531747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.533326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:54.546808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae505-ea96-4002-a80e-f96b76ca1071 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:54.559788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:54.607894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:54.608524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.608788 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.609081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] PATH_INFO: `/v3/projects/3a06a9637d094eebb1227db8e672258c` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.610275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a06a9637d094eebb1227db8e672258c)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.612172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:54.658664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a06a9637d094eebb1227db8e672258c', 'request_id': 'req-6cfb66de-0f3a-4039-9737-a01c21e4332c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.663966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a06a9637d094eebb1227db8e672258c', 'request_id': 'req-6cfb66de-0f3a-4039-9737-a01c21e4332c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.670103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a06a9637d094eebb1227db8e672258c', 'request_id': 'req-6cfb66de-0f3a-4039-9737-a01c21e4332c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.684945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] The token cache is being invalidate because project 3a06a9637d094eebb1227db8e672258c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:54.685229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.685828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6cfb66de-0f3a-4039-9737-a01c21e4332c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:54.687294 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1070/2134] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:54 2022] DELETE /identity/v3/projects/3a06a9637d094eebb1227db8e672258c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:54.692690 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.693222 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.693327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.714457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:54.715642 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:54.777326 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1065/2135] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:54.785642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.786110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.786580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.815665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:54.816867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:54.826385 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1071/2136] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:54.830701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.840382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b682dbd-c2cb-4294-86ab-f50dbe4c3b98 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:54.846159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:54.847296 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.847636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.847973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.848937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:54.849347 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.852035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:54.869570 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1066/2137] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:02:54.873956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.883603 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29173e-f28d-461a-937a-40ce9944dbec None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:54.889197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:54.889815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:54.890084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:54.890343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:54.890975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:54.892878 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:54.923914 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1072/2138] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:54 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:54.928963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:54.942307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d33d3d-4e3b-42e1-b1ab-61253789c473 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.004163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.004765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.005082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.005349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.005952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.007943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.030743 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1067/2139] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:54 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:55.035170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.045818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48368b-fc30-451e-8ab2-bae24cf76b78 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.051051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.051656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.051958 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.052226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.052899 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.054537 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.065235 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1073/2140] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:55.069637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.083290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861407d0-7c67-491f-98ed-6b1ab268a569 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.088945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.089545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.089811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.090042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.090955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.093396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071e62-f2b1-49bb-89ee-97140af83ca5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.106026 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1068/2141] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:02:55.110429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.121150 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10fbb0-7272-4e64-a216-212c80b072a3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.126558 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.127214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.127518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.127786 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] PATH_INFO: `/v3/projects/273127a5fdd34354bff36d063223dc71/users/c47e632b5bb449e99b1b8c269b0ce629/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.142565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273127a5fdd34354bff36d063223dc71, user_id=c47e632b5bb449e99b1b8c269b0ce629, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.145322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.158946 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1074/2142] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:55 2022] PUT /identity/v3/projects/273127a5fdd34354bff36d063223dc71/users/c47e632b5bb449e99b1b8c269b0ce629/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:55.169350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.169631 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.169890 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.200072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] MFA Rules not processed for user `c47e632b5bb449e99b1b8c269b0ce629`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:55.201241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:55.244769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:55.268846 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1069/2143] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:55.273517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.320733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:55.340978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580592a3-94fc-4098-aa18-b0c5e9b49cf6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.346761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.347396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.347674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.347935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.348563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.350563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.382811 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1075/2144] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:55.384248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.395861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8eb58-e86e-4f32-b009-59d8ce1bcc5e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.450701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.451250 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.451520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.451793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.452423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.454475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.481594 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1070/2145] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:55.485267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.496494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62906a98-ceaf-4997-9a33-3d383484f5cc admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.501792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.502397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.502669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.502934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.503574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.505356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.520578 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1076/2146] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:55.524739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.534936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e620511-e1d2-4093-9916-aa3f21e1b6de admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.541587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.542233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.542504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.542765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] PATH_INFO: `/v3/projects/d2f45def51c441ec9aef63774cc1b841/users/1cff8809c80740f89e046bff9fc7af27/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.558634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f45def51c441ec9aef63774cc1b841, user_id=1cff8809c80740f89e046bff9fc7af27, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.561348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.576390 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1071/2147] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:55 2022] PUT /identity/v3/projects/d2f45def51c441ec9aef63774cc1b841/users/1cff8809c80740f89e046bff9fc7af27/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:55.580340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.590327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1a41-0f0c-4487-9af2-e5046768bab3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.650167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.650787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.651066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.651334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.651966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.653656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56756f-3b5e-47a2-898b-447941f4c6a4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.663974 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1077/2148] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:55.668456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.680322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45662f57-e5a5-4000-bd35-1f29af08576c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.685232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.685914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.686213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.686487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] PATH_INFO: `/v3/projects/d2f45def51c441ec9aef63774cc1b841/users/1cff8809c80740f89e046bff9fc7af27/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.688472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f45def51c441ec9aef63774cc1b841, user_id=1cff8809c80740f89e046bff9fc7af27, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.691238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.701743 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1072/2149] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:55 2022] PUT /identity/v3/projects/d2f45def51c441ec9aef63774cc1b841/users/1cff8809c80740f89e046bff9fc7af27/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:55.713272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.713561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.713835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.744014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] MFA Rules not processed for user `1cff8809c80740f89e046bff9fc7af27`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:55.745287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:55.819530 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1078/2150] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:55.831849 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:55.833986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:55.896254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77302711-17c0-45d3-adaf-7ea8ddc0e096 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:55.900457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:55.901080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:55.901343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:55.901606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:55.911178 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:55.912602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:55.922566 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1073/2151] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:56.003087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.013133 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4051-01a9-4b74-a4e9-63aeefe32186 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.017316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.017933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.018187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.018451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.053767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:56.081015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.082498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd84ca1-a812-43b0-8bd2-0d73e06a473b service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.092260 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1079/2152] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:02:56.360069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.404045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:56.426772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538991b-12c9-4729-b7d8-8dcd8a02dcd0 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.431416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.432033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.432363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.432585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] PATH_INFO: `/v3/users/c47e632b5bb449e99b1b8c269b0ce629` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.433781 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47e632b5bb449e99b1b8c269b0ce629)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.435701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.484698 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47e632b5bb449e99b1b8c269b0ce629'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:56.485466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47e632b5bb449e99b1b8c269b0ce629'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:56.495496 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47e632b5bb449e99b1b8c269b0ce629'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:56.508544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47e632b5bb449e99b1b8c269b0ce629'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:56.516111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47e632b5bb449e99b1b8c269b0ce629'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:56.522055 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1074/2153] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:56 2022] DELETE /identity/v3/users/c47e632b5bb449e99b1b8c269b0ce629 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:56.526736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.527086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.527433 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.547634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:56.548828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:56.613917 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1080/2154] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:56.623339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.624974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:56.683569 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ffa1-dd2a-411b-bc22-153ca4498a1d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:56.687274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:56.687875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:56.688149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:56.688417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:56.697699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:56.699130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:56.708760 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1075/2155] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:02:56.985461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:56.986938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.001518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e4324-74d7-4342-a1d6-a67b7efebe3a None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.007141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.008008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.008295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.008582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] PATH_INFO: `/v3/projects/273127a5fdd34354bff36d063223dc71` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.009710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=273127a5fdd34354bff36d063223dc71)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.011631 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.059556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273127a5fdd34354bff36d063223dc71', 'request_id': 'req-7475fca7-b993-48d4-9659-e4a9a608ce7c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.065727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273127a5fdd34354bff36d063223dc71', 'request_id': 'req-7475fca7-b993-48d4-9659-e4a9a608ce7c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.072447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273127a5fdd34354bff36d063223dc71', 'request_id': 'req-7475fca7-b993-48d4-9659-e4a9a608ce7c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.091945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] The token cache is being invalidate because project 273127a5fdd34354bff36d063223dc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:57.092222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.093026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.094746 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1081/2156] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:56 2022] DELETE /identity/v3/projects/273127a5fdd34354bff36d063223dc71 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:57.099267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.109596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f227f50-b590-4f1e-9e13-c6bf7dd275f7 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.166880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.167504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.167777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.168047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] PATH_INFO: `/v3/users/1cff8809c80740f89e046bff9fc7af27` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.169197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cff8809c80740f89e046bff9fc7af27)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.171161 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.172636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:57.227354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cff8809c80740f89e046bff9fc7af27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.228007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cff8809c80740f89e046bff9fc7af27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.236797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cff8809c80740f89e046bff9fc7af27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.248548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cff8809c80740f89e046bff9fc7af27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.256317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-7c0771de-9769-4ab3-8dda-538b30d5dc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cff8809c80740f89e046bff9fc7af27'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.262870 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1076/2157] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:02:57 2022] DELETE /identity/v3/users/1cff8809c80740f89e046bff9fc7af27 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:57.537777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.539331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.554669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475fca7-b993-48d4-9659-e4a9a608ce7c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.612343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.612938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.613218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.613485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] PATH_INFO: `/v3/projects/d2f45def51c441ec9aef63774cc1b841` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.614607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f45def51c441ec9aef63774cc1b841)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.616517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.617999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:57.664977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f45def51c441ec9aef63774cc1b841', 'request_id': 'req-35a057dc-4a48-49ec-bb88-10d03a8f10d9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.670502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f45def51c441ec9aef63774cc1b841', 'request_id': 'req-35a057dc-4a48-49ec-bb88-10d03a8f10d9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.677123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f45def51c441ec9aef63774cc1b841', 'request_id': 'req-35a057dc-4a48-49ec-bb88-10d03a8f10d9'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.694619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] The token cache is being invalidate because project d2f45def51c441ec9aef63774cc1b841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:02:57.694852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.695596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-35a057dc-4a48-49ec-bb88-10d03a8f10d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:02:57.697366 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1082/2158] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:02:57 2022] DELETE /identity/v3/projects/d2f45def51c441ec9aef63774cc1b841 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:02:57.702908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.703262 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.703644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.724236 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:57.725458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.786330 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1077/2159] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:02:57.794183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.794565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.794934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.815596 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:57.816797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:57.824610 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1083/2160] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:57.828980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.838415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a1475-1ddd-4212-838f-09442ddb7ceb None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.842878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.843466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.843739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.844122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.844758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:02:57.845089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.846994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.858720 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1078/2161] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:02:57.863664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.876774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06bfe0-355e-4116-8c34-a74e2aa82643 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.881894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.882488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.882760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.883027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.883653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.885597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:57.919340 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1084/2162] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:02:57 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:57.923187 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:57.933855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e9979-1b20-4366-ba8f-72db53595ce8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:57.993226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:57.993865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:57.994339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:57.994608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:57.995269 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:57.997274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.012306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:02:58.024829 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1079/2163] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:02:57 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:02:58.029010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.039529 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c753a-7223-470c-bc08-159f73fc8cdd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.045169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.045762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.046035 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.046297 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.046981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.048746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.058948 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1085/2164] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:58.062940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.073382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd66e5-1d79-4f60-95e9-d9823e41c8a8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.079765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.080340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.080635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.080914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.081547 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.083198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcaa61-9065-4be2-bca5-5ba69c227933 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.094950 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1080/2165] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:02:58.099564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.110181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a039aa5-19b1-4218-ac4e-a218210d0521 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.115488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.116048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.116316 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.116578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] PATH_INFO: `/v3/projects/eb73b7bf82b24c0dbff890dc7d2a4e94/users/45eb0b62b1e44ba2b7cc1046570d6582/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.132141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb73b7bf82b24c0dbff890dc7d2a4e94, user_id=45eb0b62b1e44ba2b7cc1046570d6582, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.134868 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.149541 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1086/2166] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:02:58 2022] PUT /identity/v3/projects/eb73b7bf82b24c0dbff890dc7d2a4e94/users/45eb0b62b1e44ba2b7cc1046570d6582/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:02:58.161730 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.162188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.162559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.193432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] MFA Rules not processed for user `45eb0b62b1e44ba2b7cc1046570d6582`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:02:58.194647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:58.264863 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1081/2167] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:02:58.276783 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:02:58.278531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:02:58.336357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514ff40-ff07-4544-8696-06a7fd3637ff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:02:58.340240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:02:58.340860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:02:58.341164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:02:58.341428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:02:58.350236 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:02:58.351655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341639c1-8bcc-4b54-a07b-f88bfa779a26 service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:02:58.360563 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1087/2168] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:08.174283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:08.175944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.254144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0518e2-5fff-49ff-a537-c40f9a709457 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:08.259745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:08.260438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:08.260635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:08.260927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:08.262733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:08.330732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:08.332366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:08.343561 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1082/2169] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:08.356381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:12.209217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007e93-f957-4db5-bb1a-00ee8d95849d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.209886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007e93-f957-4db5-bb1a-00ee8d95849d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.210063 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007e93-f957-4db5-bb1a-00ee8d95849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.232175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2f007e93-f957-4db5-bb1a-00ee8d95849d None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:12.233458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2f007e93-f957-4db5-bb1a-00ee8d95849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:12.290255 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1088/2170] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:12.338316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:12.339710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:12.353934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:12.417095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551f238-228d-4558-8f3a-f487f88d9d25 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:12.422130 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:12.422731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:12.423004 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:12.423267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:12.431369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:12.433077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:12.441183 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1083/2171] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:22.118400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:22.119060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:22.119060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:22.139674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] MFA Rules not processed for user `2da699bb0c51440593b8175d05869203`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:22.141082 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:22.148121 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1089/2172] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:22.437950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=27 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:22.501025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:22.502856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:22.574148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac782e-145b-4c94-9680-cabbeb99f43e service swift] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:22.578362 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:22.578971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:22.579355 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:22.579620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:22.581381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:22.592504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:22.594536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34403bc1-3cba-44ff-8fe0-dd64b8670131 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:22.604873 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1084/2173] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:30.405572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:30.477643 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391eae9-3bc1-4af3-8f04-3e1ad770bc93 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:30.482481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:30.484674 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:30.485035 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:30.485359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] PATH_INFO: `/v3/users/45eb0b62b1e44ba2b7cc1046570d6582` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:30.486598 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eb0b62b1e44ba2b7cc1046570d6582)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:30.488531 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:30.550913 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eb0b62b1e44ba2b7cc1046570d6582'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:30.558804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eb0b62b1e44ba2b7cc1046570d6582'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:30.572184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eb0b62b1e44ba2b7cc1046570d6582'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:30.579514 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eb0b62b1e44ba2b7cc1046570d6582'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:30.580208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eb0b62b1e44ba2b7cc1046570d6582'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:30.586297 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1090/2174] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:30 2022] DELETE /identity/v3/users/45eb0b62b1e44ba2b7cc1046570d6582 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:30.590836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:30.591317 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:30.591426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:30.611385 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:30.612763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:30.673657 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1085/2175] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:30.683317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:30.684873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:30.706292 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:30.745475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205e33-b729-4cde-8be7-f656c4134a91 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:30.749578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:30.750164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:30.750442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:30.750702 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:30.760642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:30.762139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e2217-7597-4336-b218-2fea02104d1a service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:30.772048 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1091/2176] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:31.054930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.056600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.069960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b2703-ae66-421a-a92f-63828bfb1772 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.074619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.075253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.075529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.075800 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] PATH_INFO: `/v3/projects/eb73b7bf82b24c0dbff890dc7d2a4e94` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.076973 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb73b7bf82b24c0dbff890dc7d2a4e94)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.079365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.131701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb73b7bf82b24c0dbff890dc7d2a4e94', 'request_id': 'req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.137325 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb73b7bf82b24c0dbff890dc7d2a4e94', 'request_id': 'req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.144417 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb73b7bf82b24c0dbff890dc7d2a4e94', 'request_id': 'req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.159173 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] The token cache is being invalidate because project eb73b7bf82b24c0dbff890dc7d2a4e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:31.159462 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.161170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-9194ef06-8e2e-40b3-b699-a75a3d1b36f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:31.162957 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1086/2177] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:31 2022] DELETE /identity/v3/projects/eb73b7bf82b24c0dbff890dc7d2a4e94 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:31.168028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.168313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.168701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.196181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:31.197454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.273398 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1092/2178] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:31.276814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.277102 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.277378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.298252 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:31.299471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.307755 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1087/2179] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:31.313030 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.324602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aef74-c0ae-4415-b791-fcaf03141b76 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.329919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.330697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.331028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.331296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.331974 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:03:31.332270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.333910 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.349749 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1093/2180] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:03:31.351149 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.361465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ef895-2d5b-49bf-b482-3cb1bda40ac6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.367759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.368604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.369393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.370034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.370753 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.373040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.397574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:31.413535 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1088/2181] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:03:31 2022] POST /identity/v3/projects => generated 397 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:03:31.413803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.425806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1947cbb-ea51-49a7-af62-51605d945bdd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.492213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.492819 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.493122 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.493386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.494017 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.495929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.519341 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1094/2182] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:03:31 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:03:31.523562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.533874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103f05-bc70-4c44-8c37-9f3460af7669 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.539148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.540467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.540764 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.541017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.542098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.543241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.561005 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1089/2183] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:31.564255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.576695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b39385-560e-434a-bc2a-4a61e1e82a7f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.581688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.582368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.582729 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.583067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.583782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.585496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16130d-374b-4866-b8e7-9a5a20169747 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.600413 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1095/2184] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:03:31.601904 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.612217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f815e6-255a-4d51-bc33-b8b657d73275 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.616909 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.617563 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.617835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.618122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] PATH_INFO: `/v3/projects/2e4421d564824bc6841ab11e1374b004/users/8fc793c9717f485eba83e16dab9ccd5a/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.633200 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4421d564824bc6841ab11e1374b004, user_id=8fc793c9717f485eba83e16dab9ccd5a, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.635858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.649965 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1090/2185] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:03:31 2022] PUT /identity/v3/projects/2e4421d564824bc6841ab11e1374b004/users/8fc793c9717f485eba83e16dab9ccd5a/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:31.660334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9e49-e577-4ca7-931a-99c13729fa66 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.660814 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9e49-e577-4ca7-931a-99c13729fa66 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.661145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9e49-e577-4ca7-931a-99c13729fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.691560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-2afa9e49-e577-4ca7-931a-99c13729fa66 None None] MFA Rules not processed for user `8fc793c9717f485eba83e16dab9ccd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:31.693161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2afa9e49-e577-4ca7-931a-99c13729fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.716562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:31.796655 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1096/2186] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:31.809871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:31.812090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:31.879282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba94b1-831f-470a-939c-55ac783f0b69 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:31.882946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:31.883548 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:31.883873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:31.884142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:31.892398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:31.893856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f31d03-a953-4ce5-8a2a-55e6f68f2586 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:31.903468 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1091/2187] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:03:32.588132 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.589221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.589718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.591591 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1097/2188] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 01:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:32.598137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86821acd-3d25-40db-b1b2-1effe2102b12 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.598490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86821acd-3d25-40db-b1b2-1effe2102b12 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.598762 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86821acd-3d25-40db-b1b2-1effe2102b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.618620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-86821acd-3d25-40db-b1b2-1effe2102b12 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:32.619819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86821acd-3d25-40db-b1b2-1effe2102b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.689521 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1092/2189] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:32.702570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:32.705071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.771065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e12370-6354-4d6b-a8bd-d200ece31146 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:32.774633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:32.775242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.775521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.775822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.788291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:32.789761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0372d-a18d-48a4-8a4c-23e9b5319f95 service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:32.801357 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1098/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:32.875823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.876107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.876405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] PATH_INFO: `/` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.877819 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1093/2191] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 01:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:32.883080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737412d-2395-46a5-9040-4703547e9c9b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.883682 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737412d-2395-46a5-9040-4703547e9c9b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.884009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737412d-2395-46a5-9040-4703547e9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:32.905050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c737412d-2395-46a5-9040-4703547e9c9b None None] MFA Rules not processed for user `17c7b0785a6f43809e892a2aa4d7f8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:32.906254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c737412d-2395-46a5-9040-4703547e9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.957778 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1099/2192] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:03:32.969552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:32.971853 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:32.986799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cd303-c506-43da-8ffc-e348012cca03 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:32.990855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:32.991894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:32.992168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:32.992672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.001155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.002576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62260d8e-e4b7-44f1-b414-3abd06b8a261 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.010452 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1094/2193] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:33.094838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e937-26ca-4694-abfd-2a205108fc61 None None] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.095211 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e937-26ca-4694-abfd-2a205108fc61 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.095569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4e937-26ca-4694-abfd-2a205108fc61 None None] PATH_INFO: `/` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.097456 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1100/2194] 10.222.0.13 () {54 vars in 921 bytes} [Sun Oct 16 01:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 16 01:03:33.102755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1318653-9ffc-48a8-9b51-f1b345d2db42 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.103037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1318653-9ffc-48a8-9b51-f1b345d2db42 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.103301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1318653-9ffc-48a8-9b51-f1b345d2db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.123924 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f1318653-9ffc-48a8-9b51-f1b345d2db42 None None] MFA Rules not processed for user `3741f090453c44c2b2d2d2b41af8330d`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:33.125151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f1318653-9ffc-48a8-9b51-f1b345d2db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:33.135350 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1095/2195] 10.222.0.13 () {58 vars in 1018 bytes} [Sun Oct 16 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:33.147669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4e937-26ca-4694-abfd-2a205108fc61 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:33.162740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4e937-26ca-4694-abfd-2a205108fc61 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:33.167083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:33.167678 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:33.168105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:33.168376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:33.179105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:33.180555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:33.191733 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1101/2196] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:36.056392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:36.056936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:36.057046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:36.088326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:36.089783 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:36.126053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:36.156749 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1096/2197] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:36.178540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:36.180038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:36.237952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:36.253781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85587b7-320f-44ce-913b-225bde249023 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:36.260775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:36.261423 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:36.261843 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:36.262113 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:36.270852 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:36.272430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad82f7-2641-4da5-9dcd-af42fb4c8a95 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:36.280726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1102/2198] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:03:36.970135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:37.041329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c99719-6417-4b4e-9631-c96cc77bb077 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:37.046388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:37.047095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.047374 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.047648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] PATH_INFO: `/v3/users/8fc793c9717f485eba83e16dab9ccd5a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.048974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc793c9717f485eba83e16dab9ccd5a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:37.050926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:37.130100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc793c9717f485eba83e16dab9ccd5a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.130947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc793c9717f485eba83e16dab9ccd5a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.142740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc793c9717f485eba83e16dab9ccd5a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.156307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc793c9717f485eba83e16dab9ccd5a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.164381 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc793c9717f485eba83e16dab9ccd5a'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.173406 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1097/2199] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:03:36 2022] DELETE /identity/v3/users/8fc793c9717f485eba83e16dab9ccd5a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:37.177803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.178076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.178349 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.200059 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:37.201259 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:37.268570 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1103/2200] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:37.278720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:37.280261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:37.358486 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c80b0b-1961-439d-9cbb-e0c91e7facaf admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:37.362759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:37.363382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.363658 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.364077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.378274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:37.379851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972de6-24ca-4e7b-9f52-742584ee1931 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:37.392222 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1098/2201] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:03:37.868448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:37.870062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:37.894710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0902b7b-2756-4fac-94c5-eb447e696e6c None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:37.910924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:37.911578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:37.911904 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:37.912107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] PATH_INFO: `/v3/projects/2e4421d564824bc6841ab11e1374b004` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:37.913296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4421d564824bc6841ab11e1374b004)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:37.915221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:37.981715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4421d564824bc6841ab11e1374b004', 'request_id': 'req-4cb3abc4-914e-4d72-be62-5761f8d11c45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.988240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4421d564824bc6841ab11e1374b004', 'request_id': 'req-4cb3abc4-914e-4d72-be62-5761f8d11c45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:37.995038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4421d564824bc6841ab11e1374b004', 'request_id': 'req-4cb3abc4-914e-4d72-be62-5761f8d11c45'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:38.009637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] The token cache is being invalidate because project 2e4421d564824bc6841ab11e1374b004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:03:38.009950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:38.010578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:03:38.012083 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1104/2202] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:03:37 2022] DELETE /identity/v3/projects/2e4421d564824bc6841ab11e1374b004 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:03:47.385774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:48.006353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:03:57.599818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:57.600314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:57.600314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:57.639926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:03:57.641220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:57.725321 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1099/2203] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:03:57.737865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:03:57.739369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:03:57.836735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3abc4-914e-4d72-be62-5761f8d11c45 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:03:57.842568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:03:57.843204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:03:57.843484 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:03:57.843745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:03:57.853901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:03:57.855495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:03:57.864606 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1105/2204] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:03:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:07.723572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=45 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:07.860766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=43 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:09.834999 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:09.836580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:09.910282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec2cc-9a0f-44b6-ac75-b1c98bc45c83 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:09.914799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:09.915400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:09.915676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:09.915945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:09.917899 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:10.004519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:10.005913 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:10.025481 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1100/2205] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:13.267855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:13.269424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:13.284943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b194e51-1cfe-4cbe-977e-e3116ed067fb service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:13.289454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:13.290079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.290352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.290619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] PATH_INFO: `/v3/users/63527c420b154db4abb6e832e46ccd05` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.291764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=63527c420b154db4abb6e832e46ccd05)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:13.294036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:13.342044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63527c420b154db4abb6e832e46ccd05'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.350445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63527c420b154db4abb6e832e46ccd05'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.363003 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63527c420b154db4abb6e832e46ccd05'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.370809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63527c420b154db4abb6e832e46ccd05'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.371605 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-7c08b6c8-83c7-4de2-84f1-8211a6ec2cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63527c420b154db4abb6e832e46ccd05'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.378125 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1106/2206] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:13 2022] DELETE /identity/v3/users/63527c420b154db4abb6e832e46ccd05 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:13.557249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:13.567460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eea32b-ee47-41e4-87cf-1a65c1e27d02 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:13.626088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:13.626712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.626994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.627264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] PATH_INFO: `/v3/projects/467164d5c9154ed5ad79e0257e95de97` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.628378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467164d5c9154ed5ad79e0257e95de97)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:13.630333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:13.656452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:13.687046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467164d5c9154ed5ad79e0257e95de97', 'request_id': 'req-bde95408-090d-4365-9b76-96698ac586e6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.692428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467164d5c9154ed5ad79e0257e95de97', 'request_id': 'req-bde95408-090d-4365-9b76-96698ac586e6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.698860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467164d5c9154ed5ad79e0257e95de97', 'request_id': 'req-bde95408-090d-4365-9b76-96698ac586e6'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.712399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] The token cache is being invalidate because project 467164d5c9154ed5ad79e0257e95de97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:13.712616 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.713263 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bde95408-090d-4365-9b76-96698ac586e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:13.714772 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1101/2207] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:13 2022] DELETE /identity/v3/projects/467164d5c9154ed5ad79e0257e95de97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:13.720332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.720616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.720917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.779905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:13.781139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:13.843371 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1107/2208] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:13.851960 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.852237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.852498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.872625 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:13.873841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:13.881742 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1102/2209] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:13.887477 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:13.897321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402be61d-4249-4b8d-ac61-cc962c2db510 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:13.902524 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:13.903121 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.903395 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.903659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.904298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:13.904595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:13.906224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:13.918145 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1108/2210] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:13.922474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:13.931902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca10a7-c999-44ef-af91-709b3282d952 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:13.938061 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:13.939759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:13.940043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:13.940309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:13.940967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:13.942925 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:13.974059 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1103/2211] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:13.980024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:13.991005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a190-da22-4a7d-80f5-95b6d13ba00d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:14.018934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:14.059724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:14.060317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.060591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.060881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.061496 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:14.063418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:14.086233 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1109/2212] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:13 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:14.090450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:14.104205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff2c5c-68eb-478f-a2f9-3793d1252a25 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:14.109901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:14.110500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.110772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.111036 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.111678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:14.113321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:14.123248 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1104/2213] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:14.127442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:14.137912 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcae864-6f15-4548-881d-de541552819e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:14.142920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:14.143511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.143808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.144081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.144751 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:14.146400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e084a16-f76c-44c3-b9d4-9ff1b242a77a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:14.158808 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1110/2214] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:14.163024 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:14.173820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff8c3f-7add-427b-9a80-e3bc92e6f242 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:14.179184 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:14.179823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.180069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.180338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] PATH_INFO: `/v3/projects/911631cc9d034cc3af149f33b1ccd4b6/users/fe72a106c05242f79e1248d7ff898416/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.195891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911631cc9d034cc3af149f33b1ccd4b6, user_id=fe72a106c05242f79e1248d7ff898416, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:14.198610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:14.214707 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1105/2215] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:14 2022] PUT /identity/v3/projects/911631cc9d034cc3af149f33b1ccd4b6/users/fe72a106c05242f79e1248d7ff898416/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:14.226185 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.226465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.226732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.256570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] MFA Rules not processed for user `fe72a106c05242f79e1248d7ff898416`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:14.257833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:14.324662 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1111/2216] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:14.336103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:14.338032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:14.435306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5cbb-c178-439a-8c4d-6bbf9ef48a41 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:14.441384 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:14.441986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:14.442260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:14.442565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:14.450604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:14.452194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa094d4-c3f0-4bf1-bbfd-80b8d8e00730 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:14.461136 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1106/2217] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:19.727435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:19.791217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45da22-4108-4cd1-8236-536b110833b6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:19.796925 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:19.797616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:19.797892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:19.798157 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] PATH_INFO: `/v3/users/fe72a106c05242f79e1248d7ff898416` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:19.799372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe72a106c05242f79e1248d7ff898416)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:19.801458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:19.851120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:19.857288 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe72a106c05242f79e1248d7ff898416'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:19.866300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe72a106c05242f79e1248d7ff898416'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:19.878443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe72a106c05242f79e1248d7ff898416'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:19.885245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe72a106c05242f79e1248d7ff898416'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:19.885931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe72a106c05242f79e1248d7ff898416'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:19.891823 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1112/2218] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:19 2022] DELETE /identity/v3/users/fe72a106c05242f79e1248d7ff898416 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:19.896621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:19.897254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:19.897254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:19.917868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:19.919067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:19.927756 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:19.979657 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1107/2219] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:19.989581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:19.991114 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:20.071368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25407838-a270-4ec3-be3a-0ca84959e94b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.075630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.076224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.076494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.076784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.086793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.088262 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c7d3f-8058-4519-8b38-981acbf1e4a9 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.098910 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1113/2220] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:20.382694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.384270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:20.396760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a6794-1960-41c1-b71a-fc04e1ae9cf1 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.402378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.403419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.403699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.403964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] PATH_INFO: `/v3/projects/911631cc9d034cc3af149f33b1ccd4b6` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.405346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911631cc9d034cc3af149f33b1ccd4b6)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.407288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.457700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911631cc9d034cc3af149f33b1ccd4b6', 'request_id': 'req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:20.463301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911631cc9d034cc3af149f33b1ccd4b6', 'request_id': 'req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:20.469570 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911631cc9d034cc3af149f33b1ccd4b6', 'request_id': 'req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:20.483894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] The token cache is being invalidate because project 911631cc9d034cc3af149f33b1ccd4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:20.484181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:20.485015 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-72d3ce76-4a2b-42b1-973d-05b4b8feb9d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:20.487866 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1108/2221] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:20 2022] DELETE /identity/v3/projects/911631cc9d034cc3af149f33b1ccd4b6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:20.491592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.491870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.492137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.512728 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:20.513947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:20.574369 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1114/2222] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:20.582433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.582746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.583007 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.603675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:20.604872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:20.613997 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1109/2223] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:20.618311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.628411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ce17a-bdab-493c-9349-cd6c00066a79 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.633875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.634469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.634740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.635012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.635650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:20.635948 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.637590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.649408 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1115/2224] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:20.653619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.663567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a246de-08ba-43a8-aaff-2834c9477285 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.669619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.670207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.670474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.670763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.671364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.673313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.702589 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1110/2225] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:20 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:20.707032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.717430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094294e-52cb-414d-8cd9-45428099be51 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.741784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:20.775329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.775924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.776197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.776463 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.777180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.779081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.802578 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1116/2226] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:20 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:20.809172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.821123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41cd6a-45d7-4b2d-8271-a78fffa11a8e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.826027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.826615 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.826888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.827151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.827807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.829669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.839370 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1111/2227] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:20.843306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.854124 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8387a-4d4c-4ca1-b6e3-e63940acf426 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.859549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.860138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.860407 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.860669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.861353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.863023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399d027-eb7c-432f-9bec-e5d8d9782483 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.874794 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1117/2228] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:20.879070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:20.889285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823ac84-f93b-48a1-be12-602b9e0b2abe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:20.894635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:20.895264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.895537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.895803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] PATH_INFO: `/v3/projects/2cb83a064fc14150b8b937617c13d54e/users/b1acd08fa0764506b261d2f983d6a2da/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.910593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb83a064fc14150b8b937617c13d54e, user_id=b1acd08fa0764506b261d2f983d6a2da, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:20.913287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:20.927888 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1112/2229] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:20 2022] PUT /identity/v3/projects/2cb83a064fc14150b8b937617c13d54e/users/b1acd08fa0764506b261d2f983d6a2da/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:20.938163 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda285-d414-486b-9aff-b0007312d314 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:20.938447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda285-d414-486b-9aff-b0007312d314 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:20.938714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bda285-d414-486b-9aff-b0007312d314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:20.966984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-90bda285-d414-486b-9aff-b0007312d314 None None] MFA Rules not processed for user `b1acd08fa0764506b261d2f983d6a2da`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:20.968192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-90bda285-d414-486b-9aff-b0007312d314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:21.033445 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1118/2230] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:21.046471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:21.048789 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:21.088302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:21.133639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddac0-dafb-4b43-b0b7-bf80862588c2 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:21.139686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:21.140286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:21.140560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:21.140826 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:21.149395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:21.150983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54add3b-d6c0-4aaa-b094-8e4d42a475c9 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:21.159710 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1113/2231] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:23.897430 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bda285-d414-486b-9aff-b0007312d314 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:23.961914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bda285-d414-486b-9aff-b0007312d314 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:23.967042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:23.967665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:23.967941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:23.968209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] PATH_INFO: `/v3/users/b1acd08fa0764506b261d2f983d6a2da` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:23.969408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1acd08fa0764506b261d2f983d6a2da)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:23.971635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.016018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:24.025822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1acd08fa0764506b261d2f983d6a2da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.033646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1acd08fa0764506b261d2f983d6a2da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.046435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1acd08fa0764506b261d2f983d6a2da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.053583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1acd08fa0764506b261d2f983d6a2da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.054235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1acd08fa0764506b261d2f983d6a2da'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.060067 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1119/2232] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:23 2022] DELETE /identity/v3/users/b1acd08fa0764506b261d2f983d6a2da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:24.064538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.065019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.065131 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.084136 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:24.085370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:24.148192 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1114/2233] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:24.157939 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.159334 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:24.219249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52dcf8-c0fd-4f13-a0c8-55e4f984fd9c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.223589 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.224196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.224462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.224724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.233543 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.235029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee21f7-32cb-4819-857b-9e0d63e03c17 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.244266 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1120/2234] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:04:24.527210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.528664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:24.542785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba586c4-6399-4c37-9f07-6724d8b7f4fd None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.549309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.550070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.550372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.550645 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] PATH_INFO: `/v3/projects/2cb83a064fc14150b8b937617c13d54e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.551867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb83a064fc14150b8b937617c13d54e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.553933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.608533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb83a064fc14150b8b937617c13d54e', 'request_id': 'req-d21c6f36-e7a3-4c51-858e-9187399d35a5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.614775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb83a064fc14150b8b937617c13d54e', 'request_id': 'req-d21c6f36-e7a3-4c51-858e-9187399d35a5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.621040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb83a064fc14150b8b937617c13d54e', 'request_id': 'req-d21c6f36-e7a3-4c51-858e-9187399d35a5'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.634420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] The token cache is being invalidate because project 2cb83a064fc14150b8b937617c13d54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:24.634701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.635320 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d21c6f36-e7a3-4c51-858e-9187399d35a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:24.636824 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1115/2235] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:24 2022] DELETE /identity/v3/projects/2cb83a064fc14150b8b937617c13d54e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:24.641765 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.642052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.642326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.662465 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:24.663638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:24.728039 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1121/2236] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:04:24.735959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.736241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.736506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.756806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:24.758053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:24.767080 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1116/2237] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:24.771251 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.781421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9debdf-f96b-4687-919f-bcb3b651680d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.786639 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.787226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.787501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.787770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.788441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:24.788740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.790376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.802154 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1122/2238] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:24.807941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.821740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa374-d563-4430-97c3-cff5a44b870c None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.829072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.829694 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.829963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.830224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.830843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.832767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.864387 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1117/2239] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:24 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:24.869817 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.880280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc6ea4-6f4d-4c66-8cfc-92098a27d6fb admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.924285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:24.941232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.941832 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.942104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.942368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.942987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.944919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:24.968418 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1123/2240] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:24 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:24.973363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:24.984123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0a869-f196-4b08-a7d0-9047d7480bec admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:24.989016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:24.989601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:24.989869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:24.990133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:24.990763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:24.992351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.002175 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1118/2241] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:25.006078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.016756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e974499-d1fd-4a12-bbd5-e765a61ca22d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.022385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.022979 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.023255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.023532 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.024175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.025789 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082636af-bb1f-4410-95a3-825900906540 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.036802 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1124/2242] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:25.043286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.050006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:25.056058 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aea68-c29a-4449-b5ac-f7fbc38e45fb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.062313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.063059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.063346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.063622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] PATH_INFO: `/v3/projects/475caebe606a4f7e998b9e9c539df6b2/users/8c8ee07c79c142c29bba73534def1911/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.079188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475caebe606a4f7e998b9e9c539df6b2, user_id=8c8ee07c79c142c29bba73534def1911, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.081917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.099076 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1119/2243] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:25 2022] PUT /identity/v3/projects/475caebe606a4f7e998b9e9c539df6b2/users/8c8ee07c79c142c29bba73534def1911/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:25.109687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.109971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.110239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.138854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] MFA Rules not processed for user `8c8ee07c79c142c29bba73534def1911`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:25.140067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:25.209359 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1125/2244] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:25.216223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.280636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e857-8fdf-4727-befe-922c3d82c447 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.286090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.286683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.286956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.287217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.287841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.289788 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.322440 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1120/2245] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:25.326762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.341546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e94d1f-e370-43d1-bf42-7aa71b8a0c18 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.409098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.409699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.409975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.410250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.410972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.412946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.435372 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1126/2246] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:25 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:04:25.440774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.452035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e741b2-97ed-4cfe-a1e6-9a499acb1723 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.457767 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.458358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.458632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.458898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.459593 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.461197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.472332 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1121/2247] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:25.476441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.487137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31315909-48cc-4662-af0b-405da9fee4be admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.492720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.493457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.493737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.494004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] PATH_INFO: `/v3/projects/e65b3118a1364bcd80fa38c70682ef95/users/1809bc72527e473980f1af5ec9758c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.509810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65b3118a1364bcd80fa38c70682ef95, user_id=1809bc72527e473980f1af5ec9758c33, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.512493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.527513 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1127/2248] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:25 2022] PUT /identity/v3/projects/e65b3118a1364bcd80fa38c70682ef95/users/1809bc72527e473980f1af5ec9758c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:04:25.531578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.547696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12372c98-1bd7-4a7c-b146-75bfc26ccf33 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.605829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.606432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.606702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.606964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.607599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.609266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e1719-34a5-4ab8-a416-1a1d151648fd admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.619716 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1122/2249] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:25.624088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.634893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990f20b-a5a9-406c-ace9-904044767b02 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.639820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.640469 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.640745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.641141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] PATH_INFO: `/v3/projects/e65b3118a1364bcd80fa38c70682ef95/users/1809bc72527e473980f1af5ec9758c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.643111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65b3118a1364bcd80fa38c70682ef95, user_id=1809bc72527e473980f1af5ec9758c33, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.645813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.656314 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1128/2250] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:25 2022] PUT /identity/v3/projects/e65b3118a1364bcd80fa38c70682ef95/users/1809bc72527e473980f1af5ec9758c33/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:25.667590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.667843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.668179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.697078 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] MFA Rules not processed for user `1809bc72527e473980f1af5ec9758c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:25.698291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:25.747711 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:25.778653 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1123/2251] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:25.790052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:25.791994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:25.797047 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:25.885959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1dd96-04fc-4c06-bd73-7557544d9a64 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:25.890183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:25.890792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:25.891067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:25.891329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:25.900680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:25.902149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9e3da-e312-4954-b18b-3a4e0d343e44 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:25.911814 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1129/2252] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:25.949089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:26.011926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d86271-6b7b-4213-9f7b-66669849e98f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:26.017021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:26.017638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:26.017932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:26.018156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] PATH_INFO: `/v3/users/8c8ee07c79c142c29bba73534def1911` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:26.019346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8ee07c79c142c29bba73534def1911)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:26.021336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:26.072098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8ee07c79c142c29bba73534def1911'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.072745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8ee07c79c142c29bba73534def1911'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.080671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8ee07c79c142c29bba73534def1911'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.093231 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8ee07c79c142c29bba73534def1911'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.100707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8ee07c79c142c29bba73534def1911'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.106715 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1124/2253] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:25 2022] DELETE /identity/v3/users/8c8ee07c79c142c29bba73534def1911 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:26.111369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:26.111827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:26.111919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:26.132117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:26.133331 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:26.202068 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1130/2254] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:26.212212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:26.213760 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:26.275352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6591996-5e73-4145-bd06-bd0dc7b395c8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:26.280039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:26.280639 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:26.280985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:26.281275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:26.292746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:26.296220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:26.298411 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:26.311840 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1125/2255] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:26.589652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:26.591099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:26.604762 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c3d77-1940-43a3-bd5b-ff398e613807 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:26.610738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:26.611551 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:26.611826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:26.612074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] PATH_INFO: `/v3/projects/475caebe606a4f7e998b9e9c539df6b2` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:26.613412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=475caebe606a4f7e998b9e9c539df6b2)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:26.615284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:26.661893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475caebe606a4f7e998b9e9c539df6b2', 'request_id': 'req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.667320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475caebe606a4f7e998b9e9c539df6b2', 'request_id': 'req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.673534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475caebe606a4f7e998b9e9c539df6b2', 'request_id': 'req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.687526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] The token cache is being invalidate because project 475caebe606a4f7e998b9e9c539df6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:26.687857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.688486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.689978 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1131/2256] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:26 2022] DELETE /identity/v3/projects/475caebe606a4f7e998b9e9c539df6b2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:26.693937 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:26.703839 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5f2e-f840-41fa-ae3a-4d2382ff7b8b service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:26.761335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:26.761963 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:26.762239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:26.762511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] PATH_INFO: `/v3/users/1809bc72527e473980f1af5ec9758c33` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:26.763684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1809bc72527e473980f1af5ec9758c33)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:26.765666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:26.814364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1809bc72527e473980f1af5ec9758c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.814919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1809bc72527e473980f1af5ec9758c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.822387 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1809bc72527e473980f1af5ec9758c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.834275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1809bc72527e473980f1af5ec9758c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.841620 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6bcd4fc4-492b-40d1-8fad-2cefb02d729a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1809bc72527e473980f1af5ec9758c33'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:26.848344 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1126/2257] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:26 2022] DELETE /identity/v3/users/1809bc72527e473980f1af5ec9758c33 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:27.135079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.136500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:27.149687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dffe8-a97a-47d1-acd4-8bcac4edc53e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.158787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.212497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.213187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.213467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.213764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] PATH_INFO: `/v3/projects/e65b3118a1364bcd80fa38c70682ef95` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.214937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65b3118a1364bcd80fa38c70682ef95)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.216927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.265739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65b3118a1364bcd80fa38c70682ef95', 'request_id': 'req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:27.271650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65b3118a1364bcd80fa38c70682ef95', 'request_id': 'req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:27.277972 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65b3118a1364bcd80fa38c70682ef95', 'request_id': 'req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:27.291471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] The token cache is being invalidate because project e65b3118a1364bcd80fa38c70682ef95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:27.291747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:27.292388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3136972d-fde3-4c0f-9cdf-64ff4bdf617c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:27.293931 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1132/2258] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:27 2022] DELETE /identity/v3/projects/e65b3118a1364bcd80fa38c70682ef95 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:27.298872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.299335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.299444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.321063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:27.322340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:27.397192 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1127/2259] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:27.405170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.405454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.405687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.427103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:27.428306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:27.437206 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1133/2260] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:27.442197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.457356 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfe27d-7db1-4394-9cdf-63d4f3ff4247 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.466655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.467536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.467821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.468086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.469085 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:27.469357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.471339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.483895 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1128/2261] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:27.488408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.498058 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27083c6-36f4-401c-a4af-5ca690078961 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.504009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.504595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.504886 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.505152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.505770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.507665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.539744 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1134/2262] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:27.545970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.553333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.562227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdca60-9580-4515-8189-c9d83d5503e8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.620479 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.621053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.621327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.621598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.622211 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.624138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.645549 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1129/2263] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:27.649803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.660428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3eeb3-c884-4a20-9b62-64bafb2dc8cd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.665378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.665993 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.666269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.666534 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.667135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.668732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.678999 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1135/2264] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:27.682863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.693344 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2bb8-1fa2-4fbc-aac2-b073dab07d99 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.698819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.699403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.699676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.699941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.700573 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.702205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472aad6-de13-4602-8520-465fcdfb74a8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.712806 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1130/2265] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:27.716879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.727161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89bad4-1103-4265-a1f1-dbace400cd72 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.732037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.732739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.733051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.733308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] PATH_INFO: `/v3/projects/249234c461d249b08750d51e1f79abb6/users/56803cb1363e44a98cda3c62ea965c0b/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.749085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=249234c461d249b08750d51e1f79abb6, user_id=56803cb1363e44a98cda3c62ea965c0b, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.751784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.767698 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1136/2266] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:27 2022] PUT /identity/v3/projects/249234c461d249b08750d51e1f79abb6/users/56803cb1363e44a98cda3c62ea965c0b/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:27.779118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.779491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.779880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.811635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] MFA Rules not processed for user `56803cb1363e44a98cda3c62ea965c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:27.812864 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:27.888388 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1131/2267] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:04:27.893055 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:27.935785 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:27.958183 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f245ac-f84b-4b42-89d2-b91117f6b9bf admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:27.963437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:27.964031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:27.964301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:27.964565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:27.965206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:27.967116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:27.996233 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1137/2268] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:28.000380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.011795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d375f0-cb8e-4512-a37d-d89d1c77cdad None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.069831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.070438 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.070726 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.070978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.071600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.073560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.098452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:28.109787 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1132/2269] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:27 2022] POST /identity/v3/users => generated 307 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:28.111590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.126989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da00ddc-1906-4492-b208-d3280ba135db admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.132475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.133112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.133381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.133646 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.134276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.135876 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.146784 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1138/2270] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:28.150897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.161223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b935-fa3e-4cb9-83d8-fd955538a449 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.166155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.166803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.167071 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.167340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] PATH_INFO: `/v3/projects/18da3b32f2a44b0c977bc3ca977d3382/users/c28bf89de5364980a28e1fb2d0084422/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.183793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18da3b32f2a44b0c977bc3ca977d3382, user_id=c28bf89de5364980a28e1fb2d0084422, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.186497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.205791 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1133/2271] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:28 2022] PUT /identity/v3/projects/18da3b32f2a44b0c977bc3ca977d3382/users/c28bf89de5364980a28e1fb2d0084422/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:28.207024 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.221562 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c714103-a354-4afd-8235-a8e3184a33e2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.280995 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.281664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.281936 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.282198 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.282822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.284406 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f9f7e-0b34-4e28-a260-69303cb39e32 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.294235 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1139/2272] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:28.298538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.309382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86de97-ab10-467d-b21d-7184b84fba73 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.315165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.315805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.316079 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.316346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] PATH_INFO: `/v3/projects/18da3b32f2a44b0c977bc3ca977d3382/users/c28bf89de5364980a28e1fb2d0084422/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.318427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18da3b32f2a44b0c977bc3ca977d3382, user_id=c28bf89de5364980a28e1fb2d0084422, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.321083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.331391 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1134/2273] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:28 2022] PUT /identity/v3/projects/18da3b32f2a44b0c977bc3ca977d3382/users/c28bf89de5364980a28e1fb2d0084422/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:28.342733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.343015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.343287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.372245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] MFA Rules not processed for user `c28bf89de5364980a28e1fb2d0084422`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:28.373483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:28.445227 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1140/2274] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:28.456360 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.458314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:28.516828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dccb3-acdb-496d-aa15-2c180d17d049 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.521279 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.521873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.522151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.522409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.532043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.533500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.542902 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1135/2275] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:28.622287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:28.632240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cceeee-220c-4797-8edb-b8a66a0a4ecd None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:28.635986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:28.636587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:28.636863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:28.637118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:28.669188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:28.697618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:28.699015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17074f89-1065-43cf-a450-ded7f00aa40b service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:28.708341 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1141/2276] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:04:32.828230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:32.891238 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdda00-4748-43be-955a-440d6fc1dcfe service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:32.896059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:32.896683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:32.896988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:32.897258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] PATH_INFO: `/v3/users/56803cb1363e44a98cda3c62ea965c0b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:32.898552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56803cb1363e44a98cda3c62ea965c0b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:32.900559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:32.954033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56803cb1363e44a98cda3c62ea965c0b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:32.954582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56803cb1363e44a98cda3c62ea965c0b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:32.962273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56803cb1363e44a98cda3c62ea965c0b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:32.972519 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:32.974811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56803cb1363e44a98cda3c62ea965c0b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:32.983790 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56803cb1363e44a98cda3c62ea965c0b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:32.989745 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1136/2277] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:32 2022] DELETE /identity/v3/users/56803cb1363e44a98cda3c62ea965c0b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:32.994356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:32.994851 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:32.994962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:33.014940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:33.016243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:33.078195 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1142/2278] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:04:33.088137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:33.089612 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:33.147182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b5f46-cc37-493d-84a0-10b3d5366d1c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:33.151270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:33.151867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:33.152141 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:33.152409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:33.161952 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:33.163377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:33.172811 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1137/2279] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:33.459206 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:33.460654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:33.472976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68156abd-2227-4f63-a2d5-8c53d9f1969e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:33.478182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:33.478855 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:33.479131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:33.479410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] PATH_INFO: `/v3/projects/249234c461d249b08750d51e1f79abb6` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:33.480614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249234c461d249b08750d51e1f79abb6)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:33.482813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:33.534983 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249234c461d249b08750d51e1f79abb6', 'request_id': 'req-76f50641-c16b-47f3-a5b9-afb6095ff243'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.540965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249234c461d249b08750d51e1f79abb6', 'request_id': 'req-76f50641-c16b-47f3-a5b9-afb6095ff243'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.547833 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249234c461d249b08750d51e1f79abb6', 'request_id': 'req-76f50641-c16b-47f3-a5b9-afb6095ff243'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.563515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] The token cache is being invalidate because project 249234c461d249b08750d51e1f79abb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:33.563799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.564437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.565989 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1143/2280] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:33 2022] DELETE /identity/v3/projects/249234c461d249b08750d51e1f79abb6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:33.570008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:33.580072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93e6e6-acc6-4bb5-ae0e-5663520da964 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:33.638153 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:33.638779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:33.639056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:33.639326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] PATH_INFO: `/v3/users/c28bf89de5364980a28e1fb2d0084422` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:33.640505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28bf89de5364980a28e1fb2d0084422)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:33.642478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:33.693025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28bf89de5364980a28e1fb2d0084422'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.693771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28bf89de5364980a28e1fb2d0084422'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.702738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28bf89de5364980a28e1fb2d0084422'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.714637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28bf89de5364980a28e1fb2d0084422'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.721835 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e84c8d58-6e46-43d1-8792-1ca4da0df2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28bf89de5364980a28e1fb2d0084422'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:33.728015 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1138/2281] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:33 2022] DELETE /identity/v3/users/c28bf89de5364980a28e1fb2d0084422 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:04:34.019699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.021385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:34.034709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50641-c16b-47f3-a5b9-afb6095ff243 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.092714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:34.101689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.102680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.103137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.103617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] PATH_INFO: `/v3/projects/18da3b32f2a44b0c977bc3ca977d3382` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.104761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18da3b32f2a44b0c977bc3ca977d3382)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.106717 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.153386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18da3b32f2a44b0c977bc3ca977d3382', 'request_id': 'req-50778ffb-2969-40df-8140-b2880cd6dfd2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:34.159173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18da3b32f2a44b0c977bc3ca977d3382', 'request_id': 'req-50778ffb-2969-40df-8140-b2880cd6dfd2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:34.165620 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18da3b32f2a44b0c977bc3ca977d3382', 'request_id': 'req-50778ffb-2969-40df-8140-b2880cd6dfd2'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:34.179520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] The token cache is being invalidate because project 18da3b32f2a44b0c977bc3ca977d3382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:34.179807 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:34.180437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-50778ffb-2969-40df-8140-b2880cd6dfd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:34.181972 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1144/2282] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:34 2022] DELETE /identity/v3/projects/18da3b32f2a44b0c977bc3ca977d3382 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:34.187172 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.187771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.187771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.207946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:34.214985 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:34.216649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:34.279860 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1139/2283] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:34.288142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.288483 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.288760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.308797 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:34.310010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:34.319005 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1145/2284] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:34.323467 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.333505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02e6f8-2b72-45c4-aed5-cba7cf76b203 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.338595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.339137 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.339440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.339709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.340358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:34.340654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.342321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.356628 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1140/2285] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:34.361494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.372950 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad9fa3-b522-411b-8e05-b3c3a5c1cd58 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.378426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.379086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.379360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.379626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.380254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.382249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.411683 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1146/2286] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:34 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:34.415956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.426666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f77d-3ade-4b0d-bf53-3bae1f28cdcc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.483346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.483941 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.484213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.484511 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.485167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.487088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.510592 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1141/2287] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:34 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:34.514874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.525318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a0963-3207-476b-95a9-6eec1e48448c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.530026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.530614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.530885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.531182 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.531809 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.533481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.544236 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1147/2288] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:34.548357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.559171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92ee7-e07b-472d-9847-050c6cb3de81 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.565383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.566167 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.566537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.566809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.567450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.569110 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045d09-0c36-4fc8-8e9c-f9b7e449acfe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.579920 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1142/2289] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:34.586194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.602256 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf15f76-8f7a-4ad8-9bb7-ec5aa6c7fe21 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.609740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.610378 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.610648 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.610890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] PATH_INFO: `/v3/projects/a07acd08683e4d1c92e865bdd2ce9e53/users/ecce7b1db9a046eb87357dea200788c4/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.627298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07acd08683e4d1c92e865bdd2ce9e53, user_id=ecce7b1db9a046eb87357dea200788c4, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.630048 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.644858 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1148/2290] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:34 2022] PUT /identity/v3/projects/a07acd08683e4d1c92e865bdd2ce9e53/users/ecce7b1db9a046eb87357dea200788c4/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:34.655255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.655526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.655806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.687197 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] MFA Rules not processed for user `ecce7b1db9a046eb87357dea200788c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:34.689047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:34.759404 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1143/2291] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:34.770655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.772418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:34.830450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5cf423-df63-4bc3-995d-80eb13762de2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.834310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.834914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.835188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.835454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.843986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.845758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013b45-6cec-41d5-820f-016512a8236b service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:34.854682 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1149/2292] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:34.886735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:34.891268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:34.951513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f5715-7e0d-48b5-9753-4464d7439a89 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:34.956532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:34.957183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:34.957454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:34.957718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] PATH_INFO: `/v3/users/ecce7b1db9a046eb87357dea200788c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:34.958858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecce7b1db9a046eb87357dea200788c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:34.960776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.019677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecce7b1db9a046eb87357dea200788c4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.020613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecce7b1db9a046eb87357dea200788c4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.031978 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecce7b1db9a046eb87357dea200788c4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.044493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecce7b1db9a046eb87357dea200788c4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.051527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecce7b1db9a046eb87357dea200788c4'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.057642 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1144/2293] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:04:34 2022] DELETE /identity/v3/users/ecce7b1db9a046eb87357dea200788c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:35.062258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.062803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.062803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.082525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:35.083770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:35.103614 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:35.148682 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1150/2294] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:35.158624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.160198 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:35.220708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917d0b9-30ea-49ee-955c-9e60eede3ac8 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:35.224649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:35.225275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.225551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.225819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.234967 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:35.236394 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449e902-1bb9-4975-987d-2cd70688c5bf service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.245969 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1145/2295] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:35.524397 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.526131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:35.539265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9139c-fc1a-42bc-9464-45afc62233a0 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:35.545254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:35.545895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.546161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.546432 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] PATH_INFO: `/v3/projects/a07acd08683e4d1c92e865bdd2ce9e53` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.547654 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07acd08683e4d1c92e865bdd2ce9e53)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:35.549606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.603664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07acd08683e4d1c92e865bdd2ce9e53', 'request_id': 'req-0bbb29e3-7dce-499a-b773-da6309b7f6d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.609740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07acd08683e4d1c92e865bdd2ce9e53', 'request_id': 'req-0bbb29e3-7dce-499a-b773-da6309b7f6d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.616247 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07acd08683e4d1c92e865bdd2ce9e53', 'request_id': 'req-0bbb29e3-7dce-499a-b773-da6309b7f6d1'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.630257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] The token cache is being invalidate because project a07acd08683e4d1c92e865bdd2ce9e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:04:35.630540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.631169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0bbb29e3-7dce-499a-b773-da6309b7f6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:04:35.632649 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1151/2296] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:04:35 2022] DELETE /identity/v3/projects/a07acd08683e4d1c92e865bdd2ce9e53 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:35.637552 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442b44-5df6-4211-9802-b49275409def None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.637836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442b44-5df6-4211-9802-b49275409def None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.638093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442b44-5df6-4211-9802-b49275409def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.658169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-9b442b44-5df6-4211-9802-b49275409def None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:35.659287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9b442b44-5df6-4211-9802-b49275409def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:35.678872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:35.735574 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1146/2297] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:35.745663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.746023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.746416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.768724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:35.770009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:35.779011 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1152/2298] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:35.783419 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442b44-5df6-4211-9802-b49275409def None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.795825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442b44-5df6-4211-9802-b49275409def None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:35.803209 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:35.804101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.804521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.805040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.806088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:04:35.806487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:35.809122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.821816 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1147/2299] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:04:35.826527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.840136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec0c3-392c-43c0-9421-00dacc37d537 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:35.847267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:35.847831 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.848105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.848370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.849096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:35.851004 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.879498 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1153/2300] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:04:35 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:04:35.883662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.893964 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53b08c-a688-4b22-a98c-49e5b6c8931f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:35.958256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:35.958769 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:35.959043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:35.959307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:35.959943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:35.961907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:35.984909 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1148/2301] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:04:35 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:04:35.989278 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:35.999708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea3604-e1be-43c6-ba6f-5004686b164e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:36.004561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:36.005197 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:36.005471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:36.005740 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:36.006372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:36.007978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:36.018506 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1154/2302] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:36.022683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:36.033626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3043-0d5f-4c09-9568-0847f423363e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:36.039022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:36.039603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:36.039873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:36.040144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:36.040776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:36.042452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5e6b-ee29-4d41-b6e7-60294972b577 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:36.053490 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1149/2303] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:04:36.057657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:36.067734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e50-c2fc-49c9-a10a-49b2ae00c956 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:36.072645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:36.073319 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:36.073594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:36.073861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] PATH_INFO: `/v3/projects/864ff2f532f740a6b730c62db550497a/users/576d7d47bc93483da359a8d30f1f2dcb/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:36.089442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864ff2f532f740a6b730c62db550497a, user_id=576d7d47bc93483da359a8d30f1f2dcb, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:36.092072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:36.107622 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1155/2304] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:04:36 2022] PUT /identity/v3/projects/864ff2f532f740a6b730c62db550497a/users/576d7d47bc93483da359a8d30f1f2dcb/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:04:36.118139 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684feca-a440-44b5-af62-2482bd11d895 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:36.118424 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684feca-a440-44b5-af62-2482bd11d895 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:36.118689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684feca-a440-44b5-af62-2482bd11d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:36.146144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0684feca-a440-44b5-af62-2482bd11d895 None None] MFA Rules not processed for user `576d7d47bc93483da359a8d30f1f2dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:36.147316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0684feca-a440-44b5-af62-2482bd11d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:36.213562 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1150/2305] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:36.224591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:36.226439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:36.277557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:36.289125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc9fb5-1327-4075-9f2c-e7f032e0ff68 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:36.295351 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:36.296223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:36.296607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:36.296977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:36.305481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:36.306901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:36.315783 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1156/2306] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:37.692228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed449-2aef-4cb8-a693-217109715fe5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:37.692768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed449-2aef-4cb8-a693-217109715fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:37.692768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eed449-2aef-4cb8-a693-217109715fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:37.713608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-38eed449-2aef-4cb8-a693-217109715fe5 None None] MFA Rules not processed for user `576d7d47bc93483da359a8d30f1f2dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:37.714816 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-38eed449-2aef-4cb8-a693-217109715fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:37.723603 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1151/2307] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:38.716745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:38.718364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:38.811653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec55cd3-dece-48be-9ac9-e0277f3d55a7 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:38.817372 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:38.817977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:38.818254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:38.818523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:38.820488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:38.832763 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:38.834403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:38.845205 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1157/2308] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:04:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:04:47.708242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:48.840293 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=47 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:04:58.430754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08e9f-7142-4a92-b282-2085a685356f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:58.431314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08e9f-7142-4a92-b282-2085a685356f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:58.431314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08e9f-7142-4a92-b282-2085a685356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:58.455490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-07d08e9f-7142-4a92-b282-2085a685356f None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:58.457413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-07d08e9f-7142-4a92-b282-2085a685356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:58.513252 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1152/2309] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:58.565094 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:58.567119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:58.636289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c8873-2988-475e-bf0c-193f4c4f2bf8 service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:58.641656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:58.642518 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:58.643083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:58.643525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:58.652828 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:58.654597 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:58.663232 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1158/2310] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 16 01:04:59.250533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237868d-ec2d-4fe3-94ce-965403c15307 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:59.250833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237868d-ec2d-4fe3-94ce-965403c15307 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:59.251097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237868d-ec2d-4fe3-94ce-965403c15307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:59.270977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6237868d-ec2d-4fe3-94ce-965403c15307 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:59.272203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6237868d-ec2d-4fe3-94ce-965403c15307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:59.279732 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1153/2311] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:59.292199 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:59.303078 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1a54d-f9df-406f-9295-d5fa0467d63f service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:59.309076 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:59.309664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:59.309938 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:59.310205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:59.325012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:59.326606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:59.334994 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1159/2312] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:04:59.580555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d975e-54e5-4d95-a08b-fdfd9ffec057 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:59.580555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d975e-54e5-4d95-a08b-fdfd9ffec057 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:59.581059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d975e-54e5-4d95-a08b-fdfd9ffec057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:59.601555 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d92d975e-54e5-4d95-a08b-fdfd9ffec057 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:04:59.602944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d92d975e-54e5-4d95-a08b-fdfd9ffec057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:04:59.611081 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1154/2313] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:04:59.623536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:04:59.634627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283cbfb-c620-427a-aa3c-0a218002bd06 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:04:59.639911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:04:59.640508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:04:59.640780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:04:59.641074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:04:59.649607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:04:59.651143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:04:59.659567 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1160/2314] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:00.023125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:00.023806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:00.024199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:00.055792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:00.057339 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:00.064814 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1155/2315] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:00.078156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:00.098544 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036317c3-5a22-4898-839a-1ff93864794a service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:00.103772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:00.104368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:00.104609 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:00.104920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:00.113815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:00.115392 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b6246-6f66-4db1-8909-c55c7ef2256e service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:00.123444 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1161/2316] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:05:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:05:02.408597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:02.499458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871263d-e654-4e14-b308-19c6e8c326f5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:02.504634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:02.505449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:02.505752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:02.506022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] PATH_INFO: `/v3/users/576d7d47bc93483da359a8d30f1f2dcb` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:02.507341 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=576d7d47bc93483da359a8d30f1f2dcb)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:02.509405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:02.565111 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576d7d47bc93483da359a8d30f1f2dcb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:02.565754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576d7d47bc93483da359a8d30f1f2dcb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:02.574500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576d7d47bc93483da359a8d30f1f2dcb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:02.591661 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576d7d47bc93483da359a8d30f1f2dcb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:02.602742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576d7d47bc93483da359a8d30f1f2dcb'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:02.610151 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1156/2317] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:02 2022] DELETE /identity/v3/users/576d7d47bc93483da359a8d30f1f2dcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:02.615170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:02.615726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:02.615726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:02.638861 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:02.640203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:02.713357 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1162/2318] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:02.725709 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:02.727306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:02.734823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:02.804743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285d8af-f095-484b-a451-62dbd1702ebe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:02.819140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:02.819784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:02.820070 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:02.820358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:02.830822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:02.833098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:02.843284 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1157/2319] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:02.979720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:02.981237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:02.994181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ef215-7a6c-4515-9080-7af26431e390 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:02.998277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:02.998883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:02.999187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:02.999932 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.001146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.016139 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.018070 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eab34-f3b9-4692-bb5a-e6c8e6b65793 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.025770 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.027240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.029725 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1163/2320] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:03.042060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3c722-bbf7-49f6-8dd6-d68e59abc8c7 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.047323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.047970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.048247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.048521 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] PATH_INFO: `/v3/projects/864ff2f532f740a6b730c62db550497a` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.049780 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864ff2f532f740a6b730c62db550497a)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.057132 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.131502 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864ff2f532f740a6b730c62db550497a', 'request_id': 'req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:03.137945 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864ff2f532f740a6b730c62db550497a', 'request_id': 'req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:03.145012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864ff2f532f740a6b730c62db550497a', 'request_id': 'req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:03.162659 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] The token cache is being invalidate because project 864ff2f532f740a6b730c62db550497a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:03.162926 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:03.164357 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e69a640b-1bf4-4b22-b3f8-837c3be4ea19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:03.166099 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1158/2321] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:03 2022] DELETE /identity/v3/projects/864ff2f532f740a6b730c62db550497a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:03.171130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.171411 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.171875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.192779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:03.194306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.234733 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:03.273001 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1164/2322] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:03.279118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.279807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.279807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.299442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:03.300649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.308796 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1159/2323] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:03.312907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.323872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22c7a4-7fd2-4e3e-8a25-9d65eaf2b117 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.328377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.329025 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.329301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.329683 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.330507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:03.330934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.333103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.347181 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1165/2324] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:03.351634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.362834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572d52b-bfa1-4d62-94a7-dbafe8672f49 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.367947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.368560 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.368866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.369121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.369772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.371721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.402550 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1160/2325] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:03 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:03.406952 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.417287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeff855-f413-4144-9277-bd1e205be651 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.487479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.488101 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.488375 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.488637 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.489296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.491212 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.521038 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1166/2326] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:03 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:03.522680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.549324 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657182-18d3-4f3f-89fc-d21664b4a93a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.556855 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.558396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.558396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.558396 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.558844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.569475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.586143 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1161/2327] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:03.590776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.606374 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c5d5d-0a3c-4b16-acd5-3ac68defb376 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.611376 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.612032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.612305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.612572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.613242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.614858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d5079-cfac-4a01-be32-6a0269b38928 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.635885 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1167/2328] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:03.639903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.654699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d698de-78d1-46e5-af69-f6977603c5a3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.661122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.662164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.662596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.663027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] PATH_INFO: `/v3/projects/d7ba6d5a66ff472c8d5d709b11369271/users/0082b4aa1b09435e89dd4268f5372309/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.684410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ba6d5a66ff472c8d5d709b11369271, user_id=0082b4aa1b09435e89dd4268f5372309, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.687542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.705895 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1162/2329] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:03 2022] PUT /identity/v3/projects/d7ba6d5a66ff472c8d5d709b11369271/users/0082b4aa1b09435e89dd4268f5372309/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:03.720091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.720803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.721187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.756314 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] MFA Rules not processed for user `0082b4aa1b09435e89dd4268f5372309`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:03.757616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.847919 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1168/2330] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:03.859398 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:03.861688 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:03.895089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:03.925871 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08416291-f43d-4db3-b75c-22d8d4fd056d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:03.929453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:03.930060 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:03.930337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:03.931401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:03.941702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:03.943091 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:03.952896 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1163/2331] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:06.582607 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:06.584670 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:06.622745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:06.656680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6e2ab-991d-4f37-976d-95be72655bda None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:06.661109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:06.661734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:06.662005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:06.662270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] PATH_INFO: `/v3/users/6538a3de44cd4650b31aab5f169a8abe` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:06.663357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6538a3de44cd4650b31aab5f169a8abe)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:06.665330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:06.715305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6538a3de44cd4650b31aab5f169a8abe'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:06.724386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6538a3de44cd4650b31aab5f169a8abe'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:06.738626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6538a3de44cd4650b31aab5f169a8abe'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:06.747042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6538a3de44cd4650b31aab5f169a8abe'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:06.748626 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-26d905e2-8d49-4f72-9356-2706b317c0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6538a3de44cd4650b31aab5f169a8abe'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:06.755438 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1169/2332] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:06 2022] DELETE /identity/v3/users/6538a3de44cd4650b31aab5f169a8abe => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:07.003114 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.017819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ac4ff-3849-4041-ab85-70d9997436fe service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.101863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.102503 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.102773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.103037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] PATH_INFO: `/v3/projects/4a2d5b3b740743ba9bba7dcf77214252` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.104150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2d5b3b740743ba9bba7dcf77214252)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.106241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.155020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2d5b3b740743ba9bba7dcf77214252', 'request_id': 'req-e2480242-a11f-4f9a-bd6e-af26e20afa37'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:07.160884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2d5b3b740743ba9bba7dcf77214252', 'request_id': 'req-e2480242-a11f-4f9a-bd6e-af26e20afa37'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:07.167678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2d5b3b740743ba9bba7dcf77214252', 'request_id': 'req-e2480242-a11f-4f9a-bd6e-af26e20afa37'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:07.184316 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] The token cache is being invalidate because project 4a2d5b3b740743ba9bba7dcf77214252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:07.184793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:07.185834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e2480242-a11f-4f9a-bd6e-af26e20afa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:07.187794 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1164/2333] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:07 2022] DELETE /identity/v3/projects/4a2d5b3b740743ba9bba7dcf77214252 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:07.193243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.193593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.193967 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.221928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:07.223178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:07.283652 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1170/2334] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:07.291599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.291882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.292151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.313378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:07.315076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:07.324628 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1165/2335] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:07.328986 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.339309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65918d68-1375-472b-b1d2-6c03e40ac83f None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.345416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.346015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.346313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.346585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.347226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:07.347520 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.349145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.361889 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1171/2336] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:07.366416 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.375980 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebfebb-3b4a-4ba4-8223-8b5706523e0a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.381600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.382488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.383075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.383587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.385083 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.388056 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.426635 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1166/2337] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:07.430772 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.440634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca5a7-1f68-472e-91a1-f7f4f5635a33 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.479644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:07.499905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.500509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.500812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.501117 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.501743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.503700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.526950 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1172/2338] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:07.531180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.541473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54d1f5-7b1d-4348-abaa-084bb739a230 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.546373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.546977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.547251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.547517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.548190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.549896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.560054 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1167/2339] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:07.564242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.574793 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd6569-acf6-4b7b-bc80-174c91d8f8e1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.579777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.580384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.580666 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.580975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.581618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.583222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa763a7-3f8e-4e15-9c8f-b59206611807 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.594456 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1173/2340] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:07.598901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.609043 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0dd6-225f-4113-b9c1-800f327d235a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.613896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.614532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.614804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.615075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] PATH_INFO: `/v3/projects/5a246375517e43c6ae7624c9d930e371/users/bfe28d4ab9f947e3b8eab545b367eeef/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.631705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a246375517e43c6ae7624c9d930e371, user_id=bfe28d4ab9f947e3b8eab545b367eeef, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.634439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.637665 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:07.650836 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1168/2341] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:07 2022] PUT /identity/v3/projects/5a246375517e43c6ae7624c9d930e371/users/bfe28d4ab9f947e3b8eab545b367eeef/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:07.661225 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.661510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.661778 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.689771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] MFA Rules not processed for user `bfe28d4ab9f947e3b8eab545b367eeef`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:07.690977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:07.763271 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1174/2342] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:07.774670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:07.776568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:07.853124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263d2c9-9358-4c6a-a5ed-1a49bc076f9a admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:07.859464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:07.860063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:07.860343 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:07.860603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:07.868513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:07.870719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:07.881402 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1169/2343] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:08.097221 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:08.174143 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410d52b-76f0-4ccb-8ac3-21dead154bb5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:08.181890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:08.181890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.181890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.181890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] PATH_INFO: `/v3/users/bfe28d4ab9f947e3b8eab545b367eeef` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.182879 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe28d4ab9f947e3b8eab545b367eeef)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:08.187888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:08.240654 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:08.242878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.261719 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe28d4ab9f947e3b8eab545b367eeef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.265871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:08.275770 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe28d4ab9f947e3b8eab545b367eeef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.286766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe28d4ab9f947e3b8eab545b367eeef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.294526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe28d4ab9f947e3b8eab545b367eeef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.295274 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a6e9a9b9-f2dd-4913-abba-e16a85888cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe28d4ab9f947e3b8eab545b367eeef'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.302364 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1175/2344] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:08 2022] DELETE /identity/v3/users/bfe28d4ab9f947e3b8eab545b367eeef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:08.306566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.306916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.307298 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.315464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2be4-8676-4565-ac42-22113d91108e service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:08.326920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:08.328255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.363836 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:08.364369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.364643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.364943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.366678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.389008 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1176/2345] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:08.398959 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:08.400701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.412595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61511-952f-432d-a098-1d975a098e44 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:08.415861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:08.416306 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:08.416934 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.417188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.417442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.426773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:08.428204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4dc21-7102-4775-8e7a-3925455c89f8 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:08.431335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:08.432776 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:08.443501 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1170/2346] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:08.446055 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1177/2347] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:05:08.721246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:08.722768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.747395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e281cf-58df-4251-ac60-df00d5bf5dc6 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:08.752183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:08.752819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.753121 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.753388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] PATH_INFO: `/v3/projects/5a246375517e43c6ae7624c9d930e371` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.754504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a246375517e43c6ae7624c9d930e371)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:08.756451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:08.806984 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a246375517e43c6ae7624c9d930e371', 'request_id': 'req-0a767802-ffe0-4666-9492-29cc4bf19317'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.813336 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a246375517e43c6ae7624c9d930e371', 'request_id': 'req-0a767802-ffe0-4666-9492-29cc4bf19317'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.820116 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a246375517e43c6ae7624c9d930e371', 'request_id': 'req-0a767802-ffe0-4666-9492-29cc4bf19317'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.833579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] The token cache is being invalidate because project 5a246375517e43c6ae7624c9d930e371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:08.833866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.834531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0a767802-ffe0-4666-9492-29cc4bf19317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:08.836097 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1171/2348] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:08 2022] DELETE /identity/v3/projects/5a246375517e43c6ae7624c9d930e371 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:08.841073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.841554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.841664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.861417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:08.862634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.926928 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1178/2349] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:08.935995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.936306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.936597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.957742 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:08.958982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:08.967063 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1172/2350] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:08.971709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:08.981796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d621a88-b236-4e58-a779-1726f58e39b3 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:08.986568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:08.987238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:08.987516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:08.987780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:08.988416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:08.988710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:08.990338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.005424 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1179/2351] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:09.006643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.015808 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b487ce-593d-436f-b1d4-0aa7fbee4ce3 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.020376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.021016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.021289 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.021550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.022163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.024053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.056792 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1173/2352] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:09.061257 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.071766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a758269-2041-4c0d-bd9d-404e24f9b6a0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.113891 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:09.131454 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.132062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.132408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.132677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.133367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.135311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.158351 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1180/2353] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:09.162449 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.172851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd648a-6a89-427b-b33b-c9789e05dc70 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.177929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.178472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.178741 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.179068 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.179739 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.181373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.191941 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1174/2354] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:09.196023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.206491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932230a-3063-4a48-9867-62082e8fca45 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.211758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.212439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.212721 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.213062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.213714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.215329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3019c5ab-d8d6-4608-aca7-5df3b5db3fac admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.228892 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1181/2355] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:09.231727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.242144 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df9be-0e72-4353-85d7-bbbc09288cb5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.246803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.247441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.247712 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.247975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] PATH_INFO: `/v3/projects/3eb82329ae134619a4f0b05edce99bca/users/71e2a3a7828040bd81db60f132a6a430/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.263392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb82329ae134619a4f0b05edce99bca, user_id=71e2a3a7828040bd81db60f132a6a430, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.266273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.280420 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1175/2356] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:09 2022] PUT /identity/v3/projects/3eb82329ae134619a4f0b05edce99bca/users/71e2a3a7828040bd81db60f132a6a430/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:09.291921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.292450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.292815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.332706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] MFA Rules not processed for user `71e2a3a7828040bd81db60f132a6a430`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:09.333981 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:09.430726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1182/2357] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:09.435982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.522077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42138143-6f83-43d9-8e9f-0494633abe2c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.525628 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.526253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.526528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.526798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.527464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.529444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.541681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:09.564743 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1176/2358] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/projects => generated 355 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:09.565826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.580653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7739b4-bc5b-437d-a889-9b6bb385d668 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.647678 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.648309 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.648580 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.648859 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.649504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.651848 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.682257 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1183/2359] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:09.683453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.697104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503bc08d-6b5f-4762-b028-cb1638a99451 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.701185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.702088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.702483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.702851 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.703598 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.705413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.720590 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1177/2360] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:09.722029 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.740352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccf618-c9ae-4397-b0f6-fb441ffee78d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.740352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.740352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.740352 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.740727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] PATH_INFO: `/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4/users/fd58a822d7074e12b3a9c4d635243f72/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.756479 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=750ffa6a972e44d2ad9f49e9a5da53f4, user_id=fd58a822d7074e12b3a9c4d635243f72, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.759618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.776068 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1184/2361] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:09 2022] PUT /identity/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4/users/fd58a822d7074e12b3a9c4d635243f72/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:09.780073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.792610 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01f75f-d9c8-431f-bec6-a4ac378ae584 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.880732 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.881799 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.882094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.882459 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.883473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.885710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd422a8-57dd-4ac9-9be4-451cb0105041 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.899957 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1178/2362] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:09.906328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:09.918275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5352-4208-4871-9938-1d0d05e2a61c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:09.925009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:09.925813 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.926161 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.926506 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] PATH_INFO: `/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4/users/fd58a822d7074e12b3a9c4d635243f72/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:09.929303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750ffa6a972e44d2ad9f49e9a5da53f4, user_id=fd58a822d7074e12b3a9c4d635243f72, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:09.933481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:09.953824 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1185/2363] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:09 2022] PUT /identity/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4/users/fd58a822d7074e12b3a9c4d635243f72/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:09.961543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:09.962407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:09.963095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:10.005080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] MFA Rules not processed for user `fd58a822d7074e12b3a9c4d635243f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:10.005080 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:10.160458 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1179/2364] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:10.168145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:10.170195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:10.177326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:10.286771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd99df-7e6b-4603-b28c-fe0957083171 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:10.304235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:10.304978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:10.305260 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:10.305533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:10.316344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:10.318040 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:10.329538 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1186/2365] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:10.458643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:10.474751 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999937b-4616-468f-91d4-2a29767fd8b6 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:10.479987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:10.480759 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:10.481215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:10.482026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:10.553903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:10.555395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:10.560884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:10.568582 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1180/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:11.865118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:11.867727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:11.957799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66f2c6-3fdc-42f5-b8fc-d02f15256e8f service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:11.962264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:11.962917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:11.963203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:11.963471 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] PATH_INFO: `/v3/users/2da699bb0c51440593b8175d05869203` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:11.964613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2da699bb0c51440593b8175d05869203)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:11.966590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.015377 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2da699bb0c51440593b8175d05869203'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.023086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2da699bb0c51440593b8175d05869203'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.035725 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2da699bb0c51440593b8175d05869203'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.043184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2da699bb0c51440593b8175d05869203'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.044031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0977dce6-a3cb-4239-93ea-0eb508cb4789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2da699bb0c51440593b8175d05869203'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.051324 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1187/2367] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:11 2022] DELETE /identity/v3/users/2da699bb0c51440593b8175d05869203 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:12.245472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.263702 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa87d-1e4a-487f-b4f9-0460ae20e52b service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.327630 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.328254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.328527 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.328794 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] PATH_INFO: `/v3/projects/94363b1b0a0d48229b3bef2b1b779d2e` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.329928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94363b1b0a0d48229b3bef2b1b779d2e)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.331831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.381611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94363b1b0a0d48229b3bef2b1b779d2e', 'request_id': 'req-db6d89da-b5c4-4b13-827a-afc13e36f858'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.387145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94363b1b0a0d48229b3bef2b1b779d2e', 'request_id': 'req-db6d89da-b5c4-4b13-827a-afc13e36f858'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.393446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94363b1b0a0d48229b3bef2b1b779d2e', 'request_id': 'req-db6d89da-b5c4-4b13-827a-afc13e36f858'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.406551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] The token cache is being invalidate because project 94363b1b0a0d48229b3bef2b1b779d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:12.406834 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.407446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-db6d89da-b5c4-4b13-827a-afc13e36f858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:12.408946 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1181/2368] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:12 2022] DELETE /identity/v3/projects/94363b1b0a0d48229b3bef2b1b779d2e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:12.413888 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.414175 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.414443 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.434604 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:12.435839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:12.455823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:12.496454 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1188/2369] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:12.504677 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.504995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.505277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.525798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:12.526986 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:12.535529 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1182/2370] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:12.539883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.549635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f7259-7e11-4d1b-b075-85875ee61507 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.554356 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.554949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.555253 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.555515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.556224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:12.556522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.558137 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.570101 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1189/2371] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:12.574765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.585378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fa485-f09b-45ba-8fa7-f22473ad67e8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.590407 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.591005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.591277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.591541 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.592157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.594591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.623593 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1183/2372] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:12.627644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.638595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a08ee-28b9-4e60-8ba5-7c5c4ca80bd2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.699962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.700559 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.700850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.701123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.702044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.703734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.725244 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1190/2373] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:12.729493 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.740221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0322dc-7ba2-4e6f-b27e-c55e16597d3d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.745843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.746537 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.746809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.747074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.747740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.749361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.759192 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1184/2374] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:12.763119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.773919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1e0e8-a0bd-45d4-9ce8-f0aea3db1290 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.779992 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.780617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.780913 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.781165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.781794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.783380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9449d1a-b94e-4104-b1ad-05868696847e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.794572 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1191/2375] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:12.799372 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:12.815057 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afc146-9b5f-49e8-8de6-4750f9508a45 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:12.822562 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:12.823199 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.823454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.823719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] PATH_INFO: `/v3/projects/042713d4f0c14969941a80f6c28948a0/users/4a79e06fd1634586aa27af1633aa32ad/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.839504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042713d4f0c14969941a80f6c28948a0, user_id=4a79e06fd1634586aa27af1633aa32ad, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:12.842300 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:12.858267 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1185/2376] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:12 2022] PUT /identity/v3/projects/042713d4f0c14969941a80f6c28948a0/users/4a79e06fd1634586aa27af1633aa32ad/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:12.874536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:12.875447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:12.875903 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:12.907829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] MFA Rules not processed for user `4a79e06fd1634586aa27af1633aa32ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:12.909103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:12.983934 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1192/2377] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:12.988572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.021445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:13.058302 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081c0-78a6-4171-b818-26ed86290c73 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.065145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.065825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.066390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.066390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.066956 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.069009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.103093 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1186/2378] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:12 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:13.104287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.115502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbe74-a371-4d7a-8269-1ed1738889df None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.131511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:13.175387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.176001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.176272 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.176539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.177317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.179540 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.202460 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1193/2379] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:13 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:13.206559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.218576 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab761a0-5a4a-452a-b041-6e627c678540 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.223738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.224338 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.224611 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.224907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.225543 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.227166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.238507 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1187/2380] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:13.242767 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.253796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e23005-35cc-45f5-b3fc-92c4c6055196 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.260179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.261131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.261424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.261664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] PATH_INFO: `/v3/projects/128dd7d7b1ea468096f0556307374286/users/d4e4ecaa71f74ac59aea71844e2bf382/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.278984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=128dd7d7b1ea468096f0556307374286, user_id=d4e4ecaa71f74ac59aea71844e2bf382, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.281982 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.296437 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1194/2381] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:13 2022] PUT /identity/v3/projects/128dd7d7b1ea468096f0556307374286/users/d4e4ecaa71f74ac59aea71844e2bf382/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:13.300524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.310979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98a2ef-5256-464d-b20c-bb7a61b8a9d9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.375766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.376406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.377463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.377463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.377833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.379595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a908d80-0d85-45dc-a5d6-6c7847176ebb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.390365 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1188/2382] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:13.394600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.405098 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f00f9d-1c6d-4ce3-845c-987b2bbc7e1b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.409738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.410408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.410678 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.410941 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] PATH_INFO: `/v3/projects/128dd7d7b1ea468096f0556307374286/users/d4e4ecaa71f74ac59aea71844e2bf382/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.412818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=128dd7d7b1ea468096f0556307374286, user_id=d4e4ecaa71f74ac59aea71844e2bf382, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.415497 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.425412 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1195/2383] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:13 2022] PUT /identity/v3/projects/128dd7d7b1ea468096f0556307374286/users/d4e4ecaa71f74ac59aea71844e2bf382/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:13.439621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.439896 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.440183 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.474946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] MFA Rules not processed for user `d4e4ecaa71f74ac59aea71844e2bf382`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:13.476722 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:13.549414 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1189/2384] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:13.561619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:13.563775 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:13.623360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206df58-4c5c-4353-8d25-ab23b980d77e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:13.627536 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:13.628131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:13.628404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:13.628662 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:13.638571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:13.640088 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ddea-eba7-48d5-bc4c-97e598a52285 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:13.650687 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1196/2385] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:14.060540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:14.090104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:14.129898 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52be8d-913a-4dbd-b44f-3c807f1e55a4 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:14.134860 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:14.135473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.135745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.136011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] PATH_INFO: `/v3/users/4a79e06fd1634586aa27af1633aa32ad` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.137215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a79e06fd1634586aa27af1633aa32ad)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:14.139147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:14.194244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a79e06fd1634586aa27af1633aa32ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.194979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a79e06fd1634586aa27af1633aa32ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.203643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a79e06fd1634586aa27af1633aa32ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.216086 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a79e06fd1634586aa27af1633aa32ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.223423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a79e06fd1634586aa27af1633aa32ad'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.230631 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1190/2386] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:14 2022] DELETE /identity/v3/users/4a79e06fd1634586aa27af1633aa32ad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:14.235294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.235787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.235787 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.254773 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:14.255966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:14.316267 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1197/2387] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:14.326210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:14.327815 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:14.388393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc7b2a-d04d-4c50-a163-ee38ba384b08 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:14.392426 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:14.393146 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.393423 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.393693 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.403217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:14.404723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:14.414506 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1191/2388] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:14.687181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:14.688758 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:14.701792 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a36ec0-10fe-4536-8a15-7b1c6827e1df None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:14.718703 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:14.719677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.719964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.720217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] PATH_INFO: `/v3/projects/042713d4f0c14969941a80f6c28948a0` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.721424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042713d4f0c14969941a80f6c28948a0)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:14.723493 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:14.737895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:14.775123 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042713d4f0c14969941a80f6c28948a0', 'request_id': 'req-1e1fe124-e9d4-4b54-9daa-b95986738b01'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.781018 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042713d4f0c14969941a80f6c28948a0', 'request_id': 'req-1e1fe124-e9d4-4b54-9daa-b95986738b01'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.793741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042713d4f0c14969941a80f6c28948a0', 'request_id': 'req-1e1fe124-e9d4-4b54-9daa-b95986738b01'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.808068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] The token cache is being invalidate because project 042713d4f0c14969941a80f6c28948a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:14.808355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.809039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.813656 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1198/2389] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:14 2022] DELETE /identity/v3/projects/042713d4f0c14969941a80f6c28948a0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:14.815005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:14.825500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:14.827617 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:14.828142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c1324-2676-4d3a-8dcf-00ee3f1e3c42 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:14.877565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:14.894471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:14.898258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.898258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.898258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] PATH_INFO: `/v3/users/d4e4ecaa71f74ac59aea71844e2bf382` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.898258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e4ecaa71f74ac59aea71844e2bf382)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:14.898918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:14.914023 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe124-e9d4-4b54-9daa-b95986738b01 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:14.918930 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:14.919592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:14.919872 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:14.920142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] PATH_INFO: `/v3/users/0082b4aa1b09435e89dd4268f5372309` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:14.921380 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0082b4aa1b09435e89dd4268f5372309)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:14.923381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:14.962181 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e4ecaa71f74ac59aea71844e2bf382'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.963041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e4ecaa71f74ac59aea71844e2bf382'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.977965 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e4ecaa71f74ac59aea71844e2bf382'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.985618 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0082b4aa1b09435e89dd4268f5372309'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.990779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e4ecaa71f74ac59aea71844e2bf382'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.992919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0082b4aa1b09435e89dd4268f5372309'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:14.998256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-367dfbb6-95eb-4105-b460-769695a11ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e4ecaa71f74ac59aea71844e2bf382'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.004620 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1192/2390] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:14 2022] DELETE /identity/v3/users/d4e4ecaa71f74ac59aea71844e2bf382 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:15.006057 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0082b4aa1b09435e89dd4268f5372309'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.013091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0082b4aa1b09435e89dd4268f5372309'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.013806 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0082b4aa1b09435e89dd4268f5372309'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.020372 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1199/2391] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:14 2022] DELETE /identity/v3/users/0082b4aa1b09435e89dd4268f5372309 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:15.024894 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.025177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.025446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.044510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:15.045911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.112857 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1193/2392] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:15.123419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.125109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.147914 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:15.192329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea6eb2-f73a-4d4e-9a32-a9ecaa71c3b9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.195994 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.196667 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.197032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.197364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.206425 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.207929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe1da-05a9-45c8-a8ca-f66d9f66e521 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.218271 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1200/2393] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:15.368005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.371074 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.390839 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af4334-7d16-4f18-a5a3-7c95fa07318a None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.396301 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.396979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.397260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.397525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] PATH_INFO: `/v3/projects/128dd7d7b1ea468096f0556307374286` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.398822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128dd7d7b1ea468096f0556307374286)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.400723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.461841 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128dd7d7b1ea468096f0556307374286', 'request_id': 'req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.467540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128dd7d7b1ea468096f0556307374286', 'request_id': 'req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.468622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:15.475877 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128dd7d7b1ea468096f0556307374286', 'request_id': 'req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.495636 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] The token cache is being invalidate because project 128dd7d7b1ea468096f0556307374286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:15.496446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.497232 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.498971 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1194/2394] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:15 2022] DELETE /identity/v3/projects/128dd7d7b1ea468096f0556307374286 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:15.504089 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49deead-2619-494f-9cbc-df647a40d86a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.505176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49deead-2619-494f-9cbc-df647a40d86a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.505738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49deead-2619-494f-9cbc-df647a40d86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.527724 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-f49deead-2619-494f-9cbc-df647a40d86a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:15.528999 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-f49deead-2619-494f-9cbc-df647a40d86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.561744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.563728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.601372 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1201/2395] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:15.608908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.609296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.609669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.628622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:15.629860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.637636 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1202/2396] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:15.641421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2da8a1-f0a8-466d-bdd9-1ab79f001b92 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.641796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.646520 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.647151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.647420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.647684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] PATH_INFO: `/v3/projects/d7ba6d5a66ff472c8d5d709b11369271` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.648995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ba6d5a66ff472c8d5d709b11369271)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.650852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.651427 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f22137-0245-41d8-937c-5aea951cc6c6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.656389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.657028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.657301 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.657570 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.658246 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:15.658546 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.660138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.675544 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1203/2397] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:05:15.679835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.690310 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24969c01-ced2-48c6-a0ff-adbdb6627ea0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.696564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.697689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.698218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.698955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.699645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.701923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.711126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ba6d5a66ff472c8d5d709b11369271', 'request_id': 'req-789ce759-8f78-43cc-9f0c-454f277bd202'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.717966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ba6d5a66ff472c8d5d709b11369271', 'request_id': 'req-789ce759-8f78-43cc-9f0c-454f277bd202'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.725288 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ba6d5a66ff472c8d5d709b11369271', 'request_id': 'req-789ce759-8f78-43cc-9f0c-454f277bd202'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.732075 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1204/2398] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:15 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:15.736365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.739981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] The token cache is being invalidate because project d7ba6d5a66ff472c8d5d709b11369271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:15.740267 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.740951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:15.742680 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1195/2399] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:15 2022] DELETE /identity/v3/projects/d7ba6d5a66ff472c8d5d709b11369271 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:15.804679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92581c-5a23-48e7-b5f8-8a4a5832cfce admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.809757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.810388 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.810659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.810971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.811576 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.813591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.837562 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1205/2400] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:15 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:15.841846 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.843509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:15.917606 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ce759-8f78-43cc-9f0c-454f277bd202 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.923147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.923775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.924072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.924335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.925019 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.926666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.938539 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1196/2401] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:15.942760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.953538 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58884ef-14e3-43a1-994e-a5e681c283ee admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.958367 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.958980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.959255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.959521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:15.960168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:15.961818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd54a0f8-2d4e-4efd-ba63-9e18cba953c0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:15.964481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:15.974758 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1206/2402] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:15.978883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:15.989771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051c00-afe7-4cb1-8952-b984d704bbd9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:15.995014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:15.995666 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:15.995940 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:15.996208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] PATH_INFO: `/v3/projects/3412ebacf8a84c0287bef62abe314c6e/users/3ff4d97e38f6491cb74988663aa14185/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.008346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.013880 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3412ebacf8a84c0287bef62abe314c6e, user_id=3ff4d97e38f6491cb74988663aa14185, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.019005 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.031553 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1197/2403] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:15 2022] PUT /identity/v3/projects/3412ebacf8a84c0287bef62abe314c6e/users/3ff4d97e38f6491cb74988663aa14185/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:16.042869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.043146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.043417 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.071736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] MFA Rules not processed for user `3ff4d97e38f6491cb74988663aa14185`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:16.073231 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.156572 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1207/2404] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:16.161441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.228501 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806be470-2311-44a4-96e8-1cc822b47b44 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.236933 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.238239 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.238559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.238829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.239647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.242270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.273557 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1198/2405] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:16.277818 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.288823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79323a7d-0eb6-4336-bca4-368377b58a5e None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.348303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.348923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.349166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.349462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.350080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.352012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.375469 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1208/2406] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:16.379771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.391084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05edf-e794-4854-ba85-ebc16be55417 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.396076 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.396682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.397008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.397278 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.397915 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.399534 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.410066 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1199/2407] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:16.414269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.424482 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a53c8-86f7-4b00-affb-bb073c954ecd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.429575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.430214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.430486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.430753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] PATH_INFO: `/v3/projects/dd0bd947e11d42fabf1f4847684cc70a/users/4f896a00a11542e78f541d9b8bdf6153/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.445871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0bd947e11d42fabf1f4847684cc70a, user_id=4f896a00a11542e78f541d9b8bdf6153, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.448530 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.463298 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1209/2408] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:16 2022] PUT /identity/v3/projects/dd0bd947e11d42fabf1f4847684cc70a/users/4f896a00a11542e78f541d9b8bdf6153/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:16.467133 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.477444 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ebb3-a197-4b20-99da-f149138eacd5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.539150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.539746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.540047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.540277 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.540929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.542536 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54776fe-3137-40b5-bdcc-b584c0e1fa2a admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.552469 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1200/2409] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:16.556780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.567951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6e64b-222e-4c95-b325-da3303676684 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.573142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.573784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.574056 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.574324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] PATH_INFO: `/v3/projects/dd0bd947e11d42fabf1f4847684cc70a/users/4f896a00a11542e78f541d9b8bdf6153/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.576342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0bd947e11d42fabf1f4847684cc70a, user_id=4f896a00a11542e78f541d9b8bdf6153, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.579116 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.590431 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1210/2410] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:16 2022] PUT /identity/v3/projects/dd0bd947e11d42fabf1f4847684cc70a/users/4f896a00a11542e78f541d9b8bdf6153/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:16.600869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.601135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.601429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.632474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] MFA Rules not processed for user `4f896a00a11542e78f541d9b8bdf6153`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:16.633812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.680558 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.703735 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1201/2411] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:16.715065 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:16.717107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:16.770110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:16.778798 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e9b93-ed6e-469c-bba5-c02b25b0551a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:16.782916 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:16.783509 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:16.783780 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:16.784046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:16.793200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:16.794688 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219c963-5e70-4f80-afa9-999e16d0e6fc service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:16.804144 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1211/2412] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:18.204678 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:18.267097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b551f-2f37-484b-9b48-c6396f71ea9f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:18.272202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:18.272817 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:18.273124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:18.273388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] PATH_INFO: `/v3/users/3ff4d97e38f6491cb74988663aa14185` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:18.274546 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff4d97e38f6491cb74988663aa14185)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:18.276484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:18.326775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff4d97e38f6491cb74988663aa14185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.327345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff4d97e38f6491cb74988663aa14185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.335574 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff4d97e38f6491cb74988663aa14185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.348151 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff4d97e38f6491cb74988663aa14185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.355169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff4d97e38f6491cb74988663aa14185'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.361002 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1202/2413] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:18 2022] DELETE /identity/v3/users/3ff4d97e38f6491cb74988663aa14185 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:18.365595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:18.366079 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:18.366189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:18.385439 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:18.386613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:18.446854 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1212/2414] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:18.456676 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:18.458166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:18.515870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eaa12-6f0b-4e73-ae14-b2945491cdd1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:18.520337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:18.520966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:18.521246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:18.521483 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:18.530885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:18.532326 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:18.541789 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1203/2415] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:18.818970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:18.820404 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:18.835254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a24d9d-d5f9-4541-b6c6-6868a7fd2dc7 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:18.843632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:18.844743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:18.845095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:18.845368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] PATH_INFO: `/v3/projects/3412ebacf8a84c0287bef62abe314c6e` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:18.846883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3412ebacf8a84c0287bef62abe314c6e)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:18.849338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:18.909429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3412ebacf8a84c0287bef62abe314c6e', 'request_id': 'req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.922086 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3412ebacf8a84c0287bef62abe314c6e', 'request_id': 'req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.933474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3412ebacf8a84c0287bef62abe314c6e', 'request_id': 'req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.948467 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] The token cache is being invalidate because project 3412ebacf8a84c0287bef62abe314c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:18.948827 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.949556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:18.951197 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1213/2416] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:18 2022] DELETE /identity/v3/projects/3412ebacf8a84c0287bef62abe314c6e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:18.955390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:18.967648 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a3e1-c0a1-48d8-aa31-ed9fa293dbf7 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:18.972163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:19.037304 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.037919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.038190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.038456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] PATH_INFO: `/v3/users/4f896a00a11542e78f541d9b8bdf6153` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.039572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f896a00a11542e78f541d9b8bdf6153)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.041540 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.097002 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f896a00a11542e78f541d9b8bdf6153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.097672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f896a00a11542e78f541d9b8bdf6153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.107031 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f896a00a11542e78f541d9b8bdf6153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.120447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f896a00a11542e78f541d9b8bdf6153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.128948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-e227fd45-810f-4df5-8a74-a7a2430dd9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f896a00a11542e78f541d9b8bdf6153'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.135525 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1204/2417] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:18 2022] DELETE /identity/v3/users/4f896a00a11542e78f541d9b8bdf6153 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:19.414106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.415590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:19.429095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5230-b7d3-4d43-a32a-50a6ebdc55d3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.492503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.493173 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.493444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.493706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] PATH_INFO: `/v3/projects/dd0bd947e11d42fabf1f4847684cc70a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.494927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0bd947e11d42fabf1f4847684cc70a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.496922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.505164 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:19.545805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0bd947e11d42fabf1f4847684cc70a', 'request_id': 'req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.551179 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0bd947e11d42fabf1f4847684cc70a', 'request_id': 'req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.557651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0bd947e11d42fabf1f4847684cc70a', 'request_id': 'req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.572031 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] The token cache is being invalidate because project dd0bd947e11d42fabf1f4847684cc70a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:19.572315 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.573028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-0d1c732c-bee6-4b48-a247-9ea0578d7bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:19.574608 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1214/2418] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:19 2022] DELETE /identity/v3/projects/dd0bd947e11d42fabf1f4847684cc70a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:19.579680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.580154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.580268 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.601230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:19.602439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:19.675672 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1205/2419] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:19.683753 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.684036 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.684303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.707737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:19.708987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:19.717837 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1215/2420] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:19.723264 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.737155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2875aad-ffe8-4260-a78a-d499b9cce6d8 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.742566 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.743158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.743433 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.743727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.744361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:19.744680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.746333 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.757968 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1206/2421] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:19.761997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.771441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce1777-8c9f-48e6-a706-d16d8d053014 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.776568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.777180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.777451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.777713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.778337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.780214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.809239 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1216/2422] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:19 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:19.813365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.823415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c74086-64c3-4a6a-9dcb-6254736764eb admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.832155 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:19.883946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.884524 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.884976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.885242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.885879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.887888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.909863 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1207/2423] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:19 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:19.914002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.924776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55337243-4d93-481c-9b02-ce228cdb964a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.930505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.931050 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.931324 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.931685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.932327 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.933962 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.945157 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1217/2424] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:19.948903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.959096 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6bc32-637d-474a-8e55-bc7aaef05097 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:19.963831 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:19.964414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:19.964652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:19.964983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:19.965613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:19.967240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7885-9188-43f1-8a1f-5ff31dcca355 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:19.978340 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1208/2425] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:19.982523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:19.993224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2776b98-b568-45a7-b809-7f163267aaf5 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.000600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.001408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.001685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.001920 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] PATH_INFO: `/v3/projects/ae5432f780064cdb9cdf3cff94ea27f1/users/b47dd33923d0457eb9e48543ed4df0fe/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.020027 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5432f780064cdb9cdf3cff94ea27f1, user_id=b47dd33923d0457eb9e48543ed4df0fe, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.022837 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.036943 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1218/2426] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:19 2022] PUT /identity/v3/projects/ae5432f780064cdb9cdf3cff94ea27f1/users/b47dd33923d0457eb9e48543ed4df0fe/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:20.048638 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.049075 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.049413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.077743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] MFA Rules not processed for user `b47dd33923d0457eb9e48543ed4df0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:20.079494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:20.146517 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1209/2427] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:20.150869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.222112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85ed95-89bd-480c-bd58-0fe1ffea60d3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.227821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.228701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.229178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.229504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.230824 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.232946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.262300 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1219/2428] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:20 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:20.266793 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.277856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9da5d-08fd-41a2-9fbd-66fde6df839f None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.339590 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.340272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.340613 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.341351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.341752 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.344542 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.372867 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1210/2429] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:20 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:20.374457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.388476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffada6-3bc0-44de-bcb5-3a47c2fae125 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.393955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.394593 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.394867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.395136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.395803 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.397694 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.412874 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1220/2430] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:20.414932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.426580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4845c-800f-45b8-9823-ef17d1706e61 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.442165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.442165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.442165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.442165 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] PATH_INFO: `/v3/projects/869b80739c514691adc3b5f9f471f7e0/users/304fed6d044d46c9b2caaa49f7480be9/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.442601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:20.449150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b80739c514691adc3b5f9f471f7e0, user_id=304fed6d044d46c9b2caaa49f7480be9, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.451886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.464726 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1211/2431] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:20 2022] PUT /identity/v3/projects/869b80739c514691adc3b5f9f471f7e0/users/304fed6d044d46c9b2caaa49f7480be9/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:20.469109 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.479075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3ea94-b531-4a62-bacd-fe356b4665d4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.482650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:20.538286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.538854 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.539136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.539424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.540046 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.541672 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64914268-f4b4-42a8-b78e-241c38590300 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.551537 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1221/2432] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:20.556045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.567785 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72232848-358e-4b07-a058-a630b1021350 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.573551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.574212 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.574487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.574748 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] PATH_INFO: `/v3/projects/869b80739c514691adc3b5f9f471f7e0/users/304fed6d044d46c9b2caaa49f7480be9/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.576971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869b80739c514691adc3b5f9f471f7e0, user_id=304fed6d044d46c9b2caaa49f7480be9, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.579600 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.591149 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1212/2433] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:20 2022] PUT /identity/v3/projects/869b80739c514691adc3b5f9f471f7e0/users/304fed6d044d46c9b2caaa49f7480be9/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:20.601799 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.602085 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.602360 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.630555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] MFA Rules not processed for user `304fed6d044d46c9b2caaa49f7480be9`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:20.631761 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:20.703764 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1222/2434] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:20.715766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.717843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:20.775936 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845351e-19a4-488f-b1ef-f011c1909861 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.780065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.780649 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.780946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.781204 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.790415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.791842 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.801196 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1213/2435] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:20.848468 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:20.849933 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:20.862402 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d36fca-51aa-494a-8db7-852572cc3a35 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:20.866731 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:20.867328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:20.867571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:20.867915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:20.929354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:20.930794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23812af-2766-4cca-a73f-f45e321a1c25 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:20.940025 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1223/2436] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:24.320251 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:24.386505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536751c-1013-4adf-8a84-316ca906a884 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:24.391812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:24.392463 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:24.392740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:24.393039 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] PATH_INFO: `/v3/users/b47dd33923d0457eb9e48543ed4df0fe` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:24.394314 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47dd33923d0457eb9e48543ed4df0fe)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:24.396313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:24.443914 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47dd33923d0457eb9e48543ed4df0fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:24.444595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47dd33923d0457eb9e48543ed4df0fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:24.453017 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47dd33923d0457eb9e48543ed4df0fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:24.465710 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47dd33923d0457eb9e48543ed4df0fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:24.471746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:24.474026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47dd33923d0457eb9e48543ed4df0fe'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:24.481623 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1214/2437] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:24 2022] DELETE /identity/v3/users/b47dd33923d0457eb9e48543ed4df0fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:24.487141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:24.487668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:24.487781 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:24.509389 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:24.510645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:24.530971 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:24.571231 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1224/2438] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:24.582773 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:24.584376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:24.643705 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a317aa-fcbf-4f5e-b66a-e0ccc2ecee6b admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:24.647681 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:24.648280 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:24.648556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:24.648820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:24.657861 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:24.659285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:24.668700 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1215/2439] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:05:24.943145 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:24.944704 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:24.957451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd919b0-c0c3-4d72-a247-82cd894c2d32 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:24.962784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:24.963500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:24.963838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:24.964167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] PATH_INFO: `/v3/projects/ae5432f780064cdb9cdf3cff94ea27f1` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:24.965630 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5432f780064cdb9cdf3cff94ea27f1)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:24.967595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.016553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5432f780064cdb9cdf3cff94ea27f1', 'request_id': 'req-37b8ac19-9dad-4b2d-98ff-a68207939065'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.022210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5432f780064cdb9cdf3cff94ea27f1', 'request_id': 'req-37b8ac19-9dad-4b2d-98ff-a68207939065'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.028796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5432f780064cdb9cdf3cff94ea27f1', 'request_id': 'req-37b8ac19-9dad-4b2d-98ff-a68207939065'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.042303 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] The token cache is being invalidate because project ae5432f780064cdb9cdf3cff94ea27f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:25.042590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.043299 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.044907 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1225/2440] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:24 2022] DELETE /identity/v3/projects/ae5432f780064cdb9cdf3cff94ea27f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:25.049249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.059352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374dbed-f00a-49c3-a197-dfff882c8c8b service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.120488 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.121156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.121434 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.121683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] PATH_INFO: `/v3/users/304fed6d044d46c9b2caaa49f7480be9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.122892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] RBAC: Authorizing `identity:delete_user(user_id=304fed6d044d46c9b2caaa49f7480be9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.124885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.171754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304fed6d044d46c9b2caaa49f7480be9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.172386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304fed6d044d46c9b2caaa49f7480be9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.180095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304fed6d044d46c9b2caaa49f7480be9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.192485 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304fed6d044d46c9b2caaa49f7480be9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.199258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6dcbc115-c0bf-4b02-bfb9-c93a414b521b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304fed6d044d46c9b2caaa49f7480be9'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.205036 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1216/2441] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:25 2022] DELETE /identity/v3/users/304fed6d044d46c9b2caaa49f7480be9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:25.490033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.492015 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.514774 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8ac19-9dad-4b2d-98ff-a68207939065 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.577068 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.577697 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.577965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.578224 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] PATH_INFO: `/v3/projects/869b80739c514691adc3b5f9f471f7e0` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.579339 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=869b80739c514691adc3b5f9f471f7e0)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.581268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.629964 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869b80739c514691adc3b5f9f471f7e0', 'request_id': 'req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.631900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:25.637207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869b80739c514691adc3b5f9f471f7e0', 'request_id': 'req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.645437 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869b80739c514691adc3b5f9f471f7e0', 'request_id': 'req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.659956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] The token cache is being invalidate because project 869b80739c514691adc3b5f9f471f7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:25.660265 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.661054 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.662715 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1226/2442] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:25 2022] DELETE /identity/v3/projects/869b80739c514691adc3b5f9f471f7e0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:25.668740 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225da15-4117-4092-b3e0-354d8161cf2d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.669249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225da15-4117-4092-b3e0-354d8161cf2d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.669468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225da15-4117-4092-b3e0-354d8161cf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.690000 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2225da15-4117-4092-b3e0-354d8161cf2d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:25.691196 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2225da15-4117-4092-b3e0-354d8161cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.707863 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.708395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:25.710106 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.758288 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1217/2443] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:25.767692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.767979 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.768249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.779060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab392bd-a01b-4803-a55b-905a9b3b9a3e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.783653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.784283 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.784564 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.784849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] PATH_INFO: `/v3/users/71e2a3a7828040bd81db60f132a6a430` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.785984 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e2a3a7828040bd81db60f132a6a430)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.787895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.788622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:25.789872 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.798819 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1218/2444] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:25.802974 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.812323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c31cf-a205-44b2-8506-f943fde901f5 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.818117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.818931 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.819208 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.819474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.820305 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:25.820754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.822951 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.835339 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1219/2445] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:05:25.836456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e2a3a7828040bd81db60f132a6a430'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.839927 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.845574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e2a3a7828040bd81db60f132a6a430'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.851716 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de2d55-6d9d-43e9-bec8-dd14675d741f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.856446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.857109 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.857323 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.857608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.858225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.858323 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e2a3a7828040bd81db60f132a6a430'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.860094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.865313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e2a3a7828040bd81db60f132a6a430'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.865961 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-9e94e37a-988b-4b75-9252-0c7d6db9b984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e2a3a7828040bd81db60f132a6a430'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:25.872458 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1227/2446] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:25 2022] DELETE /identity/v3/users/71e2a3a7828040bd81db60f132a6a430 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:05:25.876784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.877130 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.877405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.890159 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1220/2447] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:25 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:25.894283 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.896050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.899112 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:25.900270 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.951095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:25.959866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32b07c-6588-4055-afc3-0fad04edccb9 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:25.961095 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1228/2448] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:25.968254 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:25.969185 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:25.969452 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:25.969718 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:25.970669 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:25.971294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:25.972624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:25.972735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:25.998355 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1221/2449] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:25 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:25.999686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.009592 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d681898-8a40-4b68-be96-9870d03f31da admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.014154 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.014784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.015055 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.015320 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.016050 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.017664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.028774 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1222/2450] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:26.029902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54ce49-1860-4afd-8da3-eef445d8df9d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.032779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.033601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.034200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.034470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.034739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.042138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974982b7-41c8-41f5-96ee-157f0767672e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.044208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.045727 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.046796 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.047371 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.047675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.047907 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.048545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.050142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadad493-eea6-4f3b-96ac-0d8237b7e7d2 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.055756 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1229/2451] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:26.064255 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1223/2452] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:26.066344 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.076039 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deab782-613f-4e98-8610-db4baf97a3e5 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.081591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.082451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.082927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.083232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] PATH_INFO: `/v3/projects/e14769d9c5aa4e4e8a330169dd023ec1/users/ae4d9e7a0dee453794b5c059de8776e6/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.104446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14769d9c5aa4e4e8a330169dd023ec1, user_id=ae4d9e7a0dee453794b5c059de8776e6, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.107519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.120195 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1230/2453] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:26 2022] PUT /identity/v3/projects/e14769d9c5aa4e4e8a330169dd023ec1/users/ae4d9e7a0dee453794b5c059de8776e6/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:26.125797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.126292 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.126561 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.146504 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:26.147723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:26.189993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:26.217290 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1224/2454] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:26.227287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.283519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72956c-9ded-4f7d-8101-e1dba884e4a6 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.287170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.287771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.288044 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.288336 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.297707 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.299136 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.308804 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1231/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:26.339349 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.340946 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:26.362582 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311001d-4a7a-431f-b3c2-06d07c108a43 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.376430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.377242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.377515 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.377777 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] PATH_INFO: `/v3/projects/3eb82329ae134619a4f0b05edce99bca` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.378920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb82329ae134619a4f0b05edce99bca)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.381011 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.429281 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb82329ae134619a4f0b05edce99bca', 'request_id': 'req-d1d6aba4-d484-4305-ab25-b85316ef9e9c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.442018 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb82329ae134619a4f0b05edce99bca', 'request_id': 'req-d1d6aba4-d484-4305-ab25-b85316ef9e9c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.448624 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb82329ae134619a4f0b05edce99bca', 'request_id': 'req-d1d6aba4-d484-4305-ab25-b85316ef9e9c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.461605 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] The token cache is being invalidate because project 3eb82329ae134619a4f0b05edce99bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:26.461891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.462526 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.464120 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1225/2456] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:26 2022] DELETE /identity/v3/projects/3eb82329ae134619a4f0b05edce99bca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:26.468134 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.478779 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8f674-5af4-43b4-9f7a-7f3ed0431c5c service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.537067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:26.537736 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.537954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.538216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] PATH_INFO: `/v3/users/fd58a822d7074e12b3a9c4d635243f72` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.539435 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd58a822d7074e12b3a9c4d635243f72)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:26.541718 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:26.566578 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:26.592075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd58a822d7074e12b3a9c4d635243f72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.601115 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd58a822d7074e12b3a9c4d635243f72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.613503 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd58a822d7074e12b3a9c4d635243f72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.621513 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd58a822d7074e12b3a9c4d635243f72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.622896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e6f6d734-586d-4263-95c3-3e2e344f57b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd58a822d7074e12b3a9c4d635243f72'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:26.629938 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1232/2457] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:26 2022] DELETE /identity/v3/users/fd58a822d7074e12b3a9c4d635243f72 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:26.921400 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:26.923140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:26.947833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6aba4-d484-4305-ab25-b85316ef9e9c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:26.953577 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:26.954005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:26.954455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:26.985608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] MFA Rules not processed for user `ae4d9e7a0dee453794b5c059de8776e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:26.986973 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.010318 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.010991 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.011261 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.011525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] PATH_INFO: `/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.012949 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=750ffa6a972e44d2ad9f49e9a5da53f4)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.014959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.069403 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750ffa6a972e44d2ad9f49e9a5da53f4', 'request_id': 'req-690f024d-7eba-4c51-832e-7bd83fa6e68c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:27.071273 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1233/2458] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:27.075340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750ffa6a972e44d2ad9f49e9a5da53f4', 'request_id': 'req-690f024d-7eba-4c51-832e-7bd83fa6e68c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:27.083810 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.085708 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.085918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750ffa6a972e44d2ad9f49e9a5da53f4', 'request_id': 'req-690f024d-7eba-4c51-832e-7bd83fa6e68c'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:27.097373 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:27.103585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] The token cache is being invalidate because project 750ffa6a972e44d2ad9f49e9a5da53f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:27.104393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:27.104930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-690f024d-7eba-4c51-832e-7bd83fa6e68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:27.108057 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1226/2459] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:26 2022] DELETE /identity/v3/projects/750ffa6a972e44d2ad9f49e9a5da53f4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:27.112472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9df8a-2c5e-40ab-90e2-ffd584041cc6 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.112993 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9df8a-2c5e-40ab-90e2-ffd584041cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.113386 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9df8a-2c5e-40ab-90e2-ffd584041cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.137672 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-0fb9df8a-2c5e-40ab-90e2-ffd584041cc6 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:27.138875 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0fb9df8a-2c5e-40ab-90e2-ffd584041cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.155681 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5037800-79f2-4c5f-8cc4-bf973673ce31 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.198071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:27.198597 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1227/2460] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:27.205627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.206296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.206574 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.206806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.206907 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.207089 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.207399 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.209091 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.226874 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:27.228041 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.236017 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1228/2461] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:05:27.240059 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.249671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129fbe-3166-4c30-ae7a-ab1609ef5144 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.255397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.255969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.256240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.256619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.257157 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:27.257457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.259035 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.269943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.271324 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1229/2462] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 16 01:05:27.274693 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.275626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.285128 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdcfce-26cf-40b1-bda0-7c61dbffebf1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.285714 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1234/2463] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:05:27.289617 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.290328 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.290458 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.290721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.291332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.293245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.322280 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1230/2464] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:27 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:27.326714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.337539 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0af49-07e7-4f1e-82fe-7b09daa51d15 service cinder] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.395110 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.395647 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.396074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.396353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.397008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.398976 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.422193 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1235/2465] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:27 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:05:27.426365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.438971 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d807c9e-5490-4422-bc4a-929f953f2692 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.444044 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.444640 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.444948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.445273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.445827 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.447435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.457647 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1231/2466] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:27.461677 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.472664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e377c3-63e2-4c93-89c1-fc8426b09633 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.477240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.477951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.478226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.478486 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.479119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.480706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb956b0b-49e2-4155-bf58-33148332a966 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.491530 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1236/2467] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:27.496220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.507309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea6c21-144a-43fa-9860-6df47b03d300 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.512578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.513306 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.513599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.513873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] PATH_INFO: `/v3/projects/157f6328c11e4162aa9ff3dcd9591da9/users/47063085a249414a84da5a3586e3861b/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.529689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157f6328c11e4162aa9ff3dcd9591da9, user_id=47063085a249414a84da5a3586e3861b, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.532451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.548733 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1232/2468] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:27 2022] PUT /identity/v3/projects/157f6328c11e4162aa9ff3dcd9591da9/users/47063085a249414a84da5a3586e3861b/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:27.557776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bf47-c479-4ec2-bff6-08d8243d1432 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.558207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bf47-c479-4ec2-bff6-08d8243d1432 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.558305 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bf47-c479-4ec2-bff6-08d8243d1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.594258 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1e4bf47-c479-4ec2-bff6-08d8243d1432 None None] MFA Rules not processed for user `47063085a249414a84da5a3586e3861b`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:27.596591 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1e4bf47-c479-4ec2-bff6-08d8243d1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.661193 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1237/2469] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:27.672883 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:27.675038 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:27.733014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24519b-ea95-4dcd-ba3a-6e20523d51b0 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:27.737226 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:27.737824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:27.738098 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:27.738353 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:27.746990 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:27.748475 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:27.758727 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1233/2470] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:28.668442 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba095-a90e-41e2-b865-e0212895d7e9 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:28.669028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba095-a90e-41e2-b865-e0212895d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:28.669028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dba095-a90e-41e2-b865-e0212895d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:28.689500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-41dba095-a90e-41e2-b865-e0212895d7e9 None None] MFA Rules not processed for user `ae4d9e7a0dee453794b5c059de8776e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:28.690915 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-41dba095-a90e-41e2-b865-e0212895d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:28.695294 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:28.750842 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1238/2471] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:33.175259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:33.204901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:33.242460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbff928-0f52-478e-b5fa-0f7804e80995 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:33.247202 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:33.247823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:33.248093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:33.248363 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] PATH_INFO: `/v3/users/47063085a249414a84da5a3586e3861b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:33.249530 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=47063085a249414a84da5a3586e3861b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:33.251442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:33.301064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47063085a249414a84da5a3586e3861b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.301755 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47063085a249414a84da5a3586e3861b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.310370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47063085a249414a84da5a3586e3861b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.322395 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47063085a249414a84da5a3586e3861b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.329174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47063085a249414a84da5a3586e3861b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.334965 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1234/2472] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:33 2022] DELETE /identity/v3/users/47063085a249414a84da5a3586e3861b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:33.339668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:33.340131 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:33.340245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:33.361501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:33.362746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:33.429538 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1239/2473] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:33.441014 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:33.442579 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:33.502313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f83c42-df60-42e9-97fa-4dfe7c5d64dc admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:33.509028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:33.509856 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:33.510190 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:33.510531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:33.522768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:33.524369 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7b84b-00ea-4757-9c2d-a0368f3dd55a service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:33.534566 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1235/2474] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:33.873505 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:33.876019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:33.894400 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9edea4-8016-43e9-a710-cb8419dfc795 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:33.899957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:33.900701 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:33.901144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:33.901478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] PATH_INFO: `/v3/projects/157f6328c11e4162aa9ff3dcd9591da9` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:33.902698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157f6328c11e4162aa9ff3dcd9591da9)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:33.904755 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:33.952954 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157f6328c11e4162aa9ff3dcd9591da9', 'request_id': 'req-6620a2bb-e930-4777-a049-a81a8ed74501'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.958277 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157f6328c11e4162aa9ff3dcd9591da9', 'request_id': 'req-6620a2bb-e930-4777-a049-a81a8ed74501'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.964561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157f6328c11e4162aa9ff3dcd9591da9', 'request_id': 'req-6620a2bb-e930-4777-a049-a81a8ed74501'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.978723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] The token cache is being invalidate because project 157f6328c11e4162aa9ff3dcd9591da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:05:33.979008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.979628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-6620a2bb-e930-4777-a049-a81a8ed74501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:33.981191 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1240/2475] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:05:33 2022] DELETE /identity/v3/projects/157f6328c11e4162aa9ff3dcd9591da9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:33.986210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:33.986481 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:33.986869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.006532 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:34.007717 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:34.049040 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:34.069000 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1236/2476] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:34.078118 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.078403 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.078699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.101053 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:34.102276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:34.110770 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1241/2477] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:34.115182 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.125270 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8338a-587c-48fb-a425-37daf79eab46 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.130366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.130965 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.131242 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.131513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.132158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:05:34.132457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.134123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.146385 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1237/2478] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:05:34.150585 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.160343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df074e-32f6-4f28-afc8-a93efa0b1dd5 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.166359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.166940 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.167227 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.167489 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.168108 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.170062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.199207 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1242/2479] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:05:34 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:34.203812 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.214550 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a864b-7eaa-4dc7-8771-a70a4825b1fe admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.274494 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.275092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.275359 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.275618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.276247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.278206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.303570 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1238/2480] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:05:34 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:05:34.309127 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.319902 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752c0b7-8384-44e2-a237-7bcf1b27bba4 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.325722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.326325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.326601 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.326870 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.327511 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.329222 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.331214 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:34.341711 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1243/2481] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 16 01:05:34.346047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.356427 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff7113-f9a7-423d-85d8-feac67f13ab6 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.365282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.365975 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.366235 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.366513 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.367245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.369334 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57012347-cb94-4435-8223-645b26836d4e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.380963 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1239/2482] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:05:34.385332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.396233 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7cd14-d422-4a72-ad81-f885d69fa74b admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.402067 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.402660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.402931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.403190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] PATH_INFO: `/v3/projects/907b807395144a6e9bae0c0ed6443af3/users/8f01f7148b6c4df4aad896792ced8673/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.418669 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=907b807395144a6e9bae0c0ed6443af3, user_id=8f01f7148b6c4df4aad896792ced8673, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.421424 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.439746 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1244/2483] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:05:34 2022] PUT /identity/v3/projects/907b807395144a6e9bae0c0ed6443af3/users/8f01f7148b6c4df4aad896792ced8673/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:34.454266 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a447ee-4854-48ca-8451-d4975926f76d None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.454557 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a447ee-4854-48ca-8451-d4975926f76d None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.454829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a447ee-4854-48ca-8451-d4975926f76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.483393 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-d9a447ee-4854-48ca-8451-d4975926f76d None None] MFA Rules not processed for user `8f01f7148b6c4df4aad896792ced8673`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:34.484655 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-d9a447ee-4854-48ca-8451-d4975926f76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:34.549848 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1240/2484] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:34.561866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:34.563777 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:34.629744 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb26f2-e03e-44a1-aae1-8f82c0a6e13c admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:34.636600 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:34.637478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:34.637850 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:34.638192 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:34.648167 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:34.649680 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:34.658958 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1245/2485] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:05:44.546837 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:44.654691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:46.454094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7904-464c-4a64-bf68-7c97ebeca174 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:46.454728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7904-464c-4a64-bf68-7c97ebeca174 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:46.454728 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df7904-464c-4a64-bf68-7c97ebeca174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:46.485308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-e9df7904-464c-4a64-bf68-7c97ebeca174 None None] MFA Rules not processed for user `ae4d9e7a0dee453794b5c059de8776e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:46.487214 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e9df7904-464c-4a64-bf68-7c97ebeca174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:46.550098 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1241/2486] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:56.542010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=25 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:05:59.592326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:59.658716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1c47-73c4-49b4-9c7c-7aa3248b240c service glance] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:59.663582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:59.664357 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:59.664679 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:59.665322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] PATH_INFO: `/v3/users/8f01f7148b6c4df4aad896792ced8673` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:59.666413 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f01f7148b6c4df4aad896792ced8673)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:59.668655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:59.717382 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f01f7148b6c4df4aad896792ced8673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:59.725885 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f01f7148b6c4df4aad896792ced8673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:59.739193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f01f7148b6c4df4aad896792ced8673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:59.747242 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f01f7148b6c4df4aad896792ced8673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:59.748043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f01f7148b6c4df4aad896792ced8673'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:05:59.754366 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1246/2487] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:05:59 2022] DELETE /identity/v3/users/8f01f7148b6c4df4aad896792ced8673 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:05:59.759145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:59.759668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:59.759668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:59.794720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:05:59.795903 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:59.859627 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1242/2488] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:05:59.869033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:05:59.870565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:05:59.929405 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294d4f6-c94b-40dd-9c55-8b73cb8c446d admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:05:59.933188 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:05:59.933796 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:05:59.934066 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:05:59.934328 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:05:59.943343 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:05:59.944756 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45035850-2a52-4220-adef-29f2404e7573 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:05:59.954120 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1247/2489] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:05:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:00.229401 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.230870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.246735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1fa21-e828-4044-94eb-ac33472ca5f0 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.253138 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.253830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.254034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.254295 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] PATH_INFO: `/v3/projects/907b807395144a6e9bae0c0ed6443af3` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.255602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=907b807395144a6e9bae0c0ed6443af3)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.257474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.308707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907b807395144a6e9bae0c0ed6443af3', 'request_id': 'req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:00.314365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907b807395144a6e9bae0c0ed6443af3', 'request_id': 'req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:00.320614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907b807395144a6e9bae0c0ed6443af3', 'request_id': 'req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:00.334327 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] The token cache is being invalidate because project 907b807395144a6e9bae0c0ed6443af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:00.334602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:00.335213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6953e33b-a6b7-4b2c-b8d4-676e7a309dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:00.336692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1243/2490] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:00 2022] DELETE /identity/v3/projects/907b807395144a6e9bae0c0ed6443af3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:00.341760 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.342043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.342313 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.363138 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:00.364386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.382208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:00.435747 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1248/2491] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:00.444700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.445022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.445290 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.466383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:00.467577 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.476254 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1244/2492] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:00.480491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.490918 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d00bff-c2a9-4367-9282-30afdc4bf203 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.496555 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.497195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.497478 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.497771 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.498412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:00.498700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.500287 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.511853 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1249/2493] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:00.516094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.525351 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1287c9-a1f9-4ae9-ac7f-2e2975b9be52 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.530233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.530818 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.531084 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.531350 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.531959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.533884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.573782 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1245/2494] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:00.578176 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.588501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18716786-bdc0-4501-8ce7-a8f7ad5dbdaa admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.648178 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.648815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.649071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.649347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.649987 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.651890 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.673255 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1250/2495] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:00.677580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.687908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a13417-7a35-4fbb-a4d3-901d0e0ae4f1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.692607 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.693228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.693498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.693779 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.694392 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.695981 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.706087 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1246/2496] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:00.710008 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.720320 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4763d8-847b-41ac-9e74-e5c86ac7a492 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.725419 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.725997 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.726266 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.726527 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.727148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.728712 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f19b97-36d5-4c2a-88ec-d90903c2d0dc admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.739855 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1251/2497] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:00.744063 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.754556 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a180334-65ce-4e4f-8c23-cba1facb58a1 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.759509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.760095 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.760408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.760641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] PATH_INFO: `/v3/projects/e076f80f62de4cb99a02e227ad3f94b9/users/dabaf0dd561f401d998af594c7544d88/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.775622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e076f80f62de4cb99a02e227ad3f94b9, user_id=dabaf0dd561f401d998af594c7544d88, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.778335 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.793584 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1247/2498] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:00 2022] PUT /identity/v3/projects/e076f80f62de4cb99a02e227ad3f94b9/users/dabaf0dd561f401d998af594c7544d88/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:00.804168 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198114d-731a-4c89-b0a8-ec41f524406b None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.804451 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198114d-731a-4c89-b0a8-ec41f524406b None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.804715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198114d-731a-4c89-b0a8-ec41f524406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.833232 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4198114d-731a-4c89-b0a8-ec41f524406b None None] MFA Rules not processed for user `dabaf0dd561f401d998af594c7544d88`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:00.834446 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4198114d-731a-4c89-b0a8-ec41f524406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.900069 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1252/2499] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:00.911641 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:00.913637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:00.927699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:00.972660 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a1484-fe28-4780-a6e6-da39351994b4 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:00.976418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:00.977087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:00.977366 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:00.977635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:00.986498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:00.987943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:00.996878 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1248/2500] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:04.959285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:04.959743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:04.959839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:04.980142 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:04.981410 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:04.994931 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:05.042078 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1253/2501] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:06:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:05.094976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:05.096863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:05.169865 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56eefcc-e3c2-4d38-8ef7-8319234355dd service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:05.175492 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:05.176129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:05.176406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:05.176674 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:05.185194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:05.186806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820a617-3388-4f91-8f46-b04f74c09391 service swift] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:05.195350 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1249/2502] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:11.290632 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:11.359582 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf39500-c2a3-42e5-8671-ffeddca01eb4 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:11.364691 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:11.365476 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:11.365857 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:11.366205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] PATH_INFO: `/v3/users/dabaf0dd561f401d998af594c7544d88` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:11.367421 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabaf0dd561f401d998af594c7544d88)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:11.369595 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:11.421033 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabaf0dd561f401d998af594c7544d88'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:11.430037 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabaf0dd561f401d998af594c7544d88'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:11.445805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabaf0dd561f401d998af594c7544d88'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:11.453200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabaf0dd561f401d998af594c7544d88'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:11.454245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabaf0dd561f401d998af594c7544d88'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:11.463515 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1254/2503] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:11 2022] DELETE /identity/v3/users/dabaf0dd561f401d998af594c7544d88 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:11.465505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:11.466012 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:11.466119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:11.486591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:11.488868 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:11.549799 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1250/2504] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:11.559645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:11.561210 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:11.610841 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:11.630429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005685-282a-4a02-9377-f52c3e8445a9 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:11.636566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:11.637533 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:11.638062 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:11.638345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:11.653975 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:11.657095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad69f6-efb0-4600-916f-77b66cee6bea service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:11.672157 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1255/2505] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:12.008708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.010457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.026784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e149bcf-1710-4930-8d8f-79531ad5f0f7 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.032140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.033069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.033482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.033848 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] PATH_INFO: `/v3/projects/e076f80f62de4cb99a02e227ad3f94b9` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.035309 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e076f80f62de4cb99a02e227ad3f94b9)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.047313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.113858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:12.124559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e076f80f62de4cb99a02e227ad3f94b9', 'request_id': 'req-15f15507-c2ec-409e-b29d-7bcd03a9e21b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.131539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e076f80f62de4cb99a02e227ad3f94b9', 'request_id': 'req-15f15507-c2ec-409e-b29d-7bcd03a9e21b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.140830 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e076f80f62de4cb99a02e227ad3f94b9', 'request_id': 'req-15f15507-c2ec-409e-b29d-7bcd03a9e21b'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.157708 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] The token cache is being invalidate because project e076f80f62de4cb99a02e227ad3f94b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:12.158420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.159259 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-15f15507-c2ec-409e-b29d-7bcd03a9e21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:12.161512 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1251/2506] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:12 2022] DELETE /identity/v3/projects/e076f80f62de4cb99a02e227ad3f94b9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:12.166481 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.166909 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.167276 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.193965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:12.195412 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.274993 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1256/2507] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:12.276203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.276699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.277180 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.301397 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:12.302704 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.314318 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1252/2508] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:12.318741 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.331229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4de57-8330-4307-8a09-7fa1943ea1fa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.337009 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.337616 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.337895 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.338165 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.338822 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:12.339120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.340723 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.356877 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1257/2509] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:12.361595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.373944 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817d4d3-61df-4fea-b3de-15672cfb8692 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.379205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.380104 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.380601 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.381030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.381987 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.385442 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.422650 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1253/2510] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:06:12.425456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.438720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2937c-23f5-4f47-a784-48ef01fc9f23 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.515820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.516434 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.516713 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.517013 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.518398 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.520353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.550982 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1258/2511] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:12.556077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.576533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bce6fd-69d6-4eb0-8cac-e58e1d48a220 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.582073 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.582679 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.582955 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.583220 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.583863 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.589597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.601926 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1254/2512] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:12.606190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.617480 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404de639-72a4-4a07-960f-ee089c0f2bbd admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.622750 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.623381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.623653 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.623921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.624554 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.626280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d5429-268b-4c3d-8712-770d2b01a7c3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.643386 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1259/2513] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:12.644673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.655377 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b438-b210-4c08-b976-2b3d9b20439f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.660213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.660895 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.661176 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.661445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] PATH_INFO: `/v3/projects/6eb6fce9d1af4831b9766b5221e83a39/users/91b45f14af1e45a491ceed5b26a353b3/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.677122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb6fce9d1af4831b9766b5221e83a39, user_id=91b45f14af1e45a491ceed5b26a353b3, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.679833 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.694589 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1255/2514] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:12 2022] PUT /identity/v3/projects/6eb6fce9d1af4831b9766b5221e83a39/users/91b45f14af1e45a491ceed5b26a353b3/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:12.699764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b436-2a0a-4978-b4aa-f984d6579e0e None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.700322 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b436-2a0a-4978-b4aa-f984d6579e0e None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.700656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b436-2a0a-4978-b4aa-f984d6579e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.721901 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1e99b436-2a0a-4978-b4aa-f984d6579e0e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:12.723353 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1e99b436-2a0a-4978-b4aa-f984d6579e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.772462 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:12.788857 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1260/2515] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:12.799887 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:12.801850 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:12.878241 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e4e21-11c8-47bf-b8d9-7cbf86283d64 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:12.883824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:12.884699 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:12.885329 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:12.885919 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:12.901032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:12.903203 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:12.915112 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1256/2516] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:13.681634 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be032d87-d19d-430a-856c-fd47b84cfb9a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.682213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be032d87-d19d-430a-856c-fd47b84cfb9a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.682213 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be032d87-d19d-430a-856c-fd47b84cfb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.733572 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-be032d87-d19d-430a-856c-fd47b84cfb9a None None] MFA Rules not processed for user `91b45f14af1e45a491ceed5b26a353b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:13.737491 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-be032d87-d19d-430a-856c-fd47b84cfb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:13.832114 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1261/2517] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:13.845352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:13.847234 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:13.935635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00774d-ac88-43c3-9d8f-2f9c720d2f9e service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:13.940008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:13.940687 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:13.941088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:13.941429 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:13.953244 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:13.955591 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:13.965869 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1257/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:15.388862 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:15.389369 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:15.389456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:15.409561 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] MFA Rules not processed for user `91b45f14af1e45a491ceed5b26a353b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:15.410784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:15.418349 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1262/2519] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:15.458706 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:15.460430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:15.474747 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:15.524216 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80df23-e18f-4f88-a1e8-6eeab03d2158 service cinder] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:15.528273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:15.529088 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:15.529364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:15.529692 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:15.531404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:15.616179 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:15.617667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967ade-4883-4c91-89e1-1a132503ac32 service glance] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:15.636959 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1258/2520] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:16.229754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:16.231281 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:16.244498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b28039-0b0f-4e08-a4b2-187838dc03ff None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:16.257135 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:16.257735 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:16.258010 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:16.258279 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:16.260921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:16.288201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:16.289739 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:16.321054 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1263/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:20.607733 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:20.608237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:20.608237 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:20.628421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:20.629651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:20.684583 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1259/2522] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 01:06:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:20.697547 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:20.699545 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:20.774103 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95993c6-5f70-423e-87e4-6323f797a122 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:20.782268 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:20.782906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:20.783181 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:20.783447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:20.792093 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:20.793737 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:20.802001 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1264/2523] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:22.789275 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:22.790843 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:22.852367 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=100 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:22.870888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea2629-4afe-41bd-9f34-fb4964e1993b None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:22.877908 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:22.878408 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:22.878719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:22.879008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:22.880916 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:22.893603 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:22.895227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:22.906654 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1260/2524] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:23.116286 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.117949 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.133171 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cb74e-2ac0-4cfa-9e42-8ccc8d37d143 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.138526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.139296 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.139640 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.139977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] PATH_INFO: `/v3/users/ae4d9e7a0dee453794b5c059de8776e6` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.141332 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4d9e7a0dee453794b5c059de8776e6)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.143363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.192043 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:23.193965 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4d9e7a0dee453794b5c059de8776e6'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.202308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4d9e7a0dee453794b5c059de8776e6'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.214663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4d9e7a0dee453794b5c059de8776e6'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.222144 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4d9e7a0dee453794b5c059de8776e6'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.222812 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-a68ae8c8-c169-4204-a2bb-6c561895601c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4d9e7a0dee453794b5c059de8776e6'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.228794 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1265/2525] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:23 2022] DELETE /identity/v3/users/ae4d9e7a0dee453794b5c059de8776e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:23.405221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.416126 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b698a-7a49-4c93-a461-ad82e9503d3e service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.472174 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.472814 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.473119 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.473412 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] PATH_INFO: `/v3/projects/e14769d9c5aa4e4e8a330169dd023ec1` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.474867 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14769d9c5aa4e4e8a330169dd023ec1)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.477027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.526291 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14769d9c5aa4e4e8a330169dd023ec1', 'request_id': 'req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.534127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14769d9c5aa4e4e8a330169dd023ec1', 'request_id': 'req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.540480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14769d9c5aa4e4e8a330169dd023ec1', 'request_id': 'req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.554805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] The token cache is being invalidate because project e14769d9c5aa4e4e8a330169dd023ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:23.555390 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.556027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-a7b1c636-9b10-43c2-a604-f41e85f7a6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:23.557555 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1261/2526] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:23 2022] DELETE /identity/v3/projects/e14769d9c5aa4e4e8a330169dd023ec1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:23.562657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153e01-9612-4834-891d-2710b78c4489 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.562943 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153e01-9612-4834-891d-2710b78c4489 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.563969 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43153e01-9612-4834-891d-2710b78c4489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.584849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-43153e01-9612-4834-891d-2710b78c4489 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:23.586107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-43153e01-9612-4834-891d-2710b78c4489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.646128 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1266/2527] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 16 01:06:23.654425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.654736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.655009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.674637 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:23.675844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:23.684147 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1262/2528] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:23.688337 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43153e01-9612-4834-891d-2710b78c4489 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.698152 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43153e01-9612-4834-891d-2710b78c4489 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.702716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.703318 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.703588 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.703849 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.704495 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:23.704763 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.706371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.719573 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1267/2529] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:23.724069 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.733460 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7576-d2bc-4219-abd7-79d2a7634923 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.738159 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.738758 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.739026 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.739287 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.739901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.741882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.770058 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1263/2530] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:23.774177 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.783937 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dc7ad-d340-4c66-b0c4-0f0ad6203e29 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.845784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.846399 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.846675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.846951 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.847638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.849622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.873893 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1268/2531] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:23 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:23.878210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.889370 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d3ebf-e557-41df-b941-6e5bf9a298a5 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.894094 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.894683 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.894953 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.895219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.895888 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.897584 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.907902 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1264/2532] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:23.911839 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.922517 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d5a5a-f96e-4a0c-98d0-ac13d50e5bf0 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.927906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.928575 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.928866 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.929148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.929784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.931426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959b39a-ed99-4146-81a2-ba82eec275f1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.941992 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1269/2533] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:23.946009 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:23.956457 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8a6b4-673e-4312-9640-09a0a73c9c8d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:23.961608 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:23.962257 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:23.962531 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:23.962807 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] PATH_INFO: `/v3/projects/0feffa4ef15d49c695dabe34887cbfad/users/ce8d557368044efa86b16c97da336726/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:23.978233 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0feffa4ef15d49c695dabe34887cbfad, user_id=ce8d557368044efa86b16c97da336726, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:23.980932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:23.998902 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1265/2534] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:23 2022] PUT /identity/v3/projects/0feffa4ef15d49c695dabe34887cbfad/users/ce8d557368044efa86b16c97da336726/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:24.015071 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.015355 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.015619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.045014 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] MFA Rules not processed for user `ce8d557368044efa86b16c97da336726`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:24.046865 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.073556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:24.124584 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1270/2535] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:24.135859 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:24.137932 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:24.153721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:24.198499 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e297836-4150-465f-8c45-d629703ad5ad admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:24.202551 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1f42430209d4ae9b1c0d039e1797a40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:24.203166 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:24.203430 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:24.203696 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:24.212684 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:24.214143 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c5cfc-f687-42d4-ae8e-51b37aede440 service cinder] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:24.223867 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1266/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:26.800894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:26.867363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb728de4-39ec-40c7-9bc8-1b811ed1eefa None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:26.875474 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:26.876429 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.876747 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.877209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] PATH_INFO: `/v3/users/ce8d557368044efa86b16c97da336726` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.879074 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce8d557368044efa86b16c97da336726)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:26.882354 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:26.937032 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce8d557368044efa86b16c97da336726'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:26.945252 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce8d557368044efa86b16c97da336726'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:26.957871 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce8d557368044efa86b16c97da336726'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:26.964823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce8d557368044efa86b16c97da336726'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:26.965501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce8d557368044efa86b16c97da336726'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:26.971861 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1271/2537] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:06:26 2022] DELETE /identity/v3/users/ce8d557368044efa86b16c97da336726 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:26.977067 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:26.977614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:26.977614 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:26.997454 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:26.998640 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.057733 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1267/2538] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:27.067802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.069359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.133240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.149955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1bff5-a95d-4f52-8a77-9d28ab74bcff admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.153659 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.154426 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.154700 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.154960 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.164271 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.165782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389219-21d3-4b0c-ac52-52e8677fb34b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.175491 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1272/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:27.443364 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.444795 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.456668 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cf847-f7ee-4db3-99b0-481428b1c723 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.462962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.463697 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.464034 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.464439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] PATH_INFO: `/v3/projects/0feffa4ef15d49c695dabe34887cbfad` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.465809 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0feffa4ef15d49c695dabe34887cbfad)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.469003 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.517884 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0feffa4ef15d49c695dabe34887cbfad', 'request_id': 'req-61dc5088-d006-4110-a517-e97a0dea8a05'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.523380 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0feffa4ef15d49c695dabe34887cbfad', 'request_id': 'req-61dc5088-d006-4110-a517-e97a0dea8a05'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.529820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0feffa4ef15d49c695dabe34887cbfad', 'request_id': 'req-61dc5088-d006-4110-a517-e97a0dea8a05'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.543701 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] The token cache is being invalidate because project 0feffa4ef15d49c695dabe34887cbfad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:06:27.543996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.544725 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-61dc5088-d006-4110-a517-e97a0dea8a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:06:27.546345 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1268/2540] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:06:27 2022] DELETE /identity/v3/projects/0feffa4ef15d49c695dabe34887cbfad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:27.551475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.551746 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.552011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.572566 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:27.573804 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.633409 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1273/2541] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:27.641445 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.641662 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.641930 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.662285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:27.663509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:27.673385 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1269/2542] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:27.677706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.687749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479344d-0b4c-43c9-bed4-62f0e282e27d None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.693394 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.693988 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.694263 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.694528 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.695169 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:06:27.695466 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.697083 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.708889 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1274/2543] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:06:27.713142 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.722754 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37066d20-7f33-466e-8be8-69083e2aa536 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.727673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.728256 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.728529 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.728798 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.729450 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.731378 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.760358 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1270/2544] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:27.764645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.775001 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5fc3-c603-4870-8c1f-1788085c2960 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.832494 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.833205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.833371 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.833671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.834289 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.836200 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.860189 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1275/2545] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:27.864539 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.875135 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78237471-0727-450c-8f28-6c15c082be4d admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.880065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.880664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.880977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.881249 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.881893 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.883497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.885597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:27.895726 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1271/2546] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:27.899448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.909448 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839728d-4e3c-41d8-8879-cd18ff66a29f admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.914384 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.914970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.915243 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.915507 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.916140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.917750 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ead13-a9f9-42ea-ab54-7820917d1888 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.928559 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1276/2547] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:27.932627 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:27.943046 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a32-2457-4f87-ba34-37af6b43a060 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:27.948217 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:27.948878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.949163 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.949428 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] PATH_INFO: `/v3/projects/7f2d2934c1834e02a6568c67cea56be5/users/0ba011221c4d4f5aa17d63bec4762c42/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:27.964797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d2934c1834e02a6568c67cea56be5, user_id=0ba011221c4d4f5aa17d63bec4762c42, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:27.967892 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:27.983258 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1272/2548] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:27 2022] PUT /identity/v3/projects/7f2d2934c1834e02a6568c67cea56be5/users/0ba011221c4d4f5aa17d63bec4762c42/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:27.988241 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca08f6-773b-4c79-a601-a7833348975a None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:27.988521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca08f6-773b-4c79-a601-a7833348975a None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:27.988768 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca08f6-773b-4c79-a601-a7833348975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:28.008209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-fbca08f6-773b-4c79-a601-a7833348975a None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:28.009523 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-fbca08f6-773b-4c79-a601-a7833348975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:28.056408 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:28.076230 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1277/2549] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:28.086911 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:28.089022 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:28.150644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0b453-600d-481a-bc90-25cd2e885363 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:28.156077 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:28.157148 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:28.157414 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:28.157675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:28.167999 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:28.169549 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:28.179435 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1273/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:32.210613 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.211228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.211228 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.248488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] MFA Rules not processed for user `0ba011221c4d4f5aa17d63bec4762c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:32.248488 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:32.343907 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1278/2551] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:32.348406 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.358996 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c72798-31dd-4815-a274-604cee0f7a6e service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.364263 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.365016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.365680 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.366016 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.366744 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.369844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.402678 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1274/2552] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:32.407847 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.419280 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750608c-0137-42d3-b9b5-4e8338202791 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.483923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.484550 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.484821 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.485120 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.485900 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.488096 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.517955 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1279/2553] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:06:32 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:06:32.522604 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.533822 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454b5d4-1c53-42df-a8fb-a1ce11a9bfff admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.538869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.539634 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.540006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.540507 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.541337 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.546346 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.559778 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1275/2554] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:32.566510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.580823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458234d1-6c30-4a28-a11e-ebaeecef82e8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.585571 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.586525 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.587516 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.588295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] PATH_INFO: `/v3/projects/559c79592c32439ca441888ff50173a8/users/15fa0536145847beaa34543028d27183/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.607689 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559c79592c32439ca441888ff50173a8, user_id=15fa0536145847beaa34543028d27183, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.612195 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.630580 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1280/2555] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:32 2022] PUT /identity/v3/projects/559c79592c32439ca441888ff50173a8/users/15fa0536145847beaa34543028d27183/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:06:32.634331 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.646032 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f04f2-b918-40b6-a9a3-9f0a87ecaa35 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.718122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.718745 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.719021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.719284 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.719920 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.721618 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5140990-9d7c-4a5f-a0a2-3e47f878b730 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.737228 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1276/2556] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:06:32.742610 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:32.759307 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ff7dc-bb19-46d5-8fec-46205d7e4ac2 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:32.764791 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:32.765586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:32.765929 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:32.766759 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] PATH_INFO: `/v3/projects/559c79592c32439ca441888ff50173a8/users/15fa0536145847beaa34543028d27183/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:32.768409 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559c79592c32439ca441888ff50173a8, user_id=15fa0536145847beaa34543028d27183, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:32.771156 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:32.787309 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1281/2557] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:06:32 2022] PUT /identity/v3/projects/559c79592c32439ca441888ff50173a8/users/15fa0536145847beaa34543028d27183/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 16 01:06:37.443365 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677adcd-c759-48f3-a7b2-f3fd18b84435 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:37.443844 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677adcd-c759-48f3-a7b2-f3fd18b84435 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:37.443957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677adcd-c759-48f3-a7b2-f3fd18b84435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:37.479221 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-1677adcd-c759-48f3-a7b2-f3fd18b84435 None None] MFA Rules not processed for user `15fa0536145847beaa34543028d27183`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:37.480495 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-1677adcd-c759-48f3-a7b2-f3fd18b84435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:37.516322 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:37.567688 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1277/2558] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:37.586734 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:37.588985 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:37.625189 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:37.654581 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06864b4a-f84d-49c4-82c5-846f6aca0f19 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:37.658239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1ad7b6fd7e432c9b56d2a5bad33854', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:37.658835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:37.659107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:37.659373 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:37.720955 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:37.722415 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:37.733922 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1282/2559] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:37.877439 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c54de-a113-4b08-9552-e8d1c27eb99c None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:37.877806 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c54de-a113-4b08-9552-e8d1c27eb99c None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:37.878118 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c54de-a113-4b08-9552-e8d1c27eb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:37.932224 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-b12c54de-a113-4b08-9552-e8d1c27eb99c None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:37.933805 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b12c54de-a113-4b08-9552-e8d1c27eb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:37.998535 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1278/2560] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:06:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:38.012361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:38.014072 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:38.115695 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528feb4-1db1-416c-bf1c-a53c137f5c2d service glance] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:38.121651 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:38.122282 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:38.122557 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:38.122825 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:38.131202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:38.132815 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:38.140897 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1283/2561] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:46.774066 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbf82-1c0d-46e0-98e7-7bc592712447 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:46.774621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbf82-1c0d-46e0-98e7-7bc592712447 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:46.774621 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fbf82-1c0d-46e0-98e7-7bc592712447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:46.794213 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-151fbf82-1c0d-46e0-98e7-7bc592712447 None None] MFA Rules not processed for user `0ba011221c4d4f5aa17d63bec4762c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:46.795509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-151fbf82-1c0d-46e0-98e7-7bc592712447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:46.802792 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1279/2562] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:47.414714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:47.416151 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:47.472080 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=100 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:06:47.489325 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280c615-8d5e-4281-ba6b-d586c685068a service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:47.494510 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:47.495107 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:47.495379 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:47.495665 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:47.498526 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:47.515340 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:47.517455 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:47.533538 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1284/2563] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:48.173901 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b221e-c74f-4e7f-93d0-f4fcfd81a348 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:48.174465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b221e-c74f-4e7f-93d0-f4fcfd81a348 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:48.174465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b221e-c74f-4e7f-93d0-f4fcfd81a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:48.195053 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-125b221e-c74f-4e7f-93d0-f4fcfd81a348 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:48.196308 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-125b221e-c74f-4e7f-93d0-f4fcfd81a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:48.259420 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1280/2564] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:48.280650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:48.282184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:48.358126 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1f1c-be27-4b4d-91eb-cd249bace29b service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:48.364147 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:48.364743 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:48.365045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:48.365311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:48.373645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:48.375218 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:48.385346 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1285/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:06:49.914478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:49.915042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:49.915042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:49.936194 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:06:49.937854 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:06:49.945889 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1281/2566] 10.222.0.13 () {58 vars in 1009 bytes} [Sun Oct 16 01:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:06:49.960073 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:06:49.976418 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b4a7-805e-4970-934d-95382f8f44bf service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:06:49.981826 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:06:49.982548 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:06:49.982887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:06:49.983216 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:06:49.997991 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:06:49.999754 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:06:50.008408 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1286/2567] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:06:59.931303 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=89 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:00.005052 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=48 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:02.488635 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:02.490164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:02.546107 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edecb0-fe77-4bc5-ad7e-ce1f4a3411ec None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:02.549870 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:02.550471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:02.550738 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:02.551001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:02.552720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:02.562568 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:02.564006 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a6f74-871f-4c9d-a41b-4a691b875df9 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:02.572168 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1282/2568] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:03.215922 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:03.230396 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f79e50-345e-4863-a5a0-51f2b9e64807 service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:03.236947 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:03.237560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:03.237820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:03.238084 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:03.240042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:03.253906 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:03.255504 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:03.267179 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1287/2569] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:04.770476 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:04.771253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:04.771253 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:04.793471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:04.794456 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:04.803453 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1283/2570] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:04.844586 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:04.856267 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf543211-7d5e-42c9-85ab-06bdb9107d56 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:04.862383 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:04.862970 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:04.863235 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:04.863500 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:04.871722 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:04.873329 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135f0d-c2ee-4157-8a12-faa40c6dbaa7 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:04.883475 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1288/2571] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:09.579474 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:09.581008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:09.598878 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e14cc-6f55-4020-a6ba-e0c0dd7a306e None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:09.604447 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:09.605082 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:09.605358 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:09.605626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:09.607376 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:09.619957 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:09.621766 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:09.632925 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1284/2572] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:14.277720 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9393-eb95-4a19-9f88-00db37030199 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.278295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9393-eb95-4a19-9f88-00db37030199 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.278295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9393-eb95-4a19-9f88-00db37030199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.299875 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-e04d9393-eb95-4a19-9f88-00db37030199 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:14.301347 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e04d9393-eb95-4a19-9f88-00db37030199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:14.310678 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1289/2573] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:14.337544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:14.349786 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017671b-9d19-4746-ad25-47fad56e0ab8 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:14.356177 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:14.356772 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:14.357072 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:14.357340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:14.365866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:14.367482 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:14.381441 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1285/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:18.403624 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:18.404363 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:18.404502 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:18.429668 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:18.430873 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:18.440495 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1290/2575] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:18.462332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:18.474313 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5feb1-772c-496b-9899-bbf14c9ba64f service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:18.481247 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:18.481847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:18.482227 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:18.482670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:18.491228 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:18.492869 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:18.502413 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1286/2576] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:19.861835 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:19.872675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb721e42-427e-4849-9749-3e512b2189c1 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:19.876602 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:19.877239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:19.877515 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:19.877782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:19.888075 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:19.889590 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26595fd0-0530-4faf-9207-3962ec61e4d1 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:19.899036 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1291/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:21.511421 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:21.524969 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e9c6f-e85e-4906-9c7a-ee6c4c22676d service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:21.532597 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:21.533505 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:21.533852 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:21.534342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:21.536383 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:21.551092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:21.552765 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:21.566511 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1287/2578] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:22.611498 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c854a07-5103-4b8b-963f-95b8aea09b17 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:22.612892 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c854a07-5103-4b8b-963f-95b8aea09b17 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:22.613757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c854a07-5103-4b8b-963f-95b8aea09b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:22.638917 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-5c854a07-5103-4b8b-963f-95b8aea09b17 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:22.640261 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5c854a07-5103-4b8b-963f-95b8aea09b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:22.654337 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1292/2579] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:22.676282 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:22.689170 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc677ce-24c3-43c7-89e8-1f47df37a8a3 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:22.695258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:22.695943 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:22.696210 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:22.696471 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:22.704797 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:22.706431 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:22.715900 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1288/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:25.807508 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00fcd-305f-4018-a774-ac3e036d62ea None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:25.808312 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00fcd-305f-4018-a774-ac3e036d62ea None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:25.808519 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c00fcd-305f-4018-a774-ac3e036d62ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:25.834869 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-01c00fcd-305f-4018-a774-ac3e036d62ea None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:25.836069 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-01c00fcd-305f-4018-a774-ac3e036d62ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:25.845793 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1293/2581] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:25.871847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:25.884029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b369e-4ac3-4cc6-ad99-f11ac00493f6 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:25.890675 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:25.891273 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:25.891538 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:25.891804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:25.900533 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:25.902192 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:25.912230 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1289/2582] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:35.829125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=30 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:35.907510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=65 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:41.075893 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9a0d-e6c5-4dbd-96ea-ffa0eea1f683 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:41.076428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9a0d-e6c5-4dbd-96ea-ffa0eea1f683 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:41.076428 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b9a0d-e6c5-4dbd-96ea-ffa0eea1f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:41.097458 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-292b9a0d-e6c5-4dbd-96ea-ffa0eea1f683 None None] MFA Rules not processed for user `91b45f14af1e45a491ceed5b26a353b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:41.098675 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-292b9a0d-e6c5-4dbd-96ea-ffa0eea1f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:41.154338 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1294/2583] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:41.388410 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:41.403782 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb28e4-4742-4cf8-8057-604fb9a439fc service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:41.408824 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:41.409436 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:41.409707 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:41.410010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:41.412361 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:41.422500 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:41.423928 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:41.432417 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1290/2584] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:51.147549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=25 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:51.428664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:07:55.417619 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa594-850c-4641-ac34-a0dd70d072d1 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:55.418166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa594-850c-4641-ac34-a0dd70d072d1 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:55.418166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fa594-850c-4641-ac34-a0dd70d072d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:55.439381 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-3c9fa594-850c-4641-ac34-a0dd70d072d1 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:55.440568 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-3c9fa594-850c-4641-ac34-a0dd70d072d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:55.449115 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1295/2585] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:55.469029 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:55.484171 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9a07b-a82c-4030-840e-3552eafbe06b service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:55.491215 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:55.491838 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:55.492101 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:55.492418 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:55.501405 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:55.503001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:55.512971 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1291/2586] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:07:58.715905 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0305-bff4-4c36-b3cb-72437c5bc236 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:58.716450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0305-bff4-4c36-b3cb-72437c5bc236 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:58.716450 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a0305-bff4-4c36-b3cb-72437c5bc236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:58.737470 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-cd3a0305-bff4-4c36-b3cb-72437c5bc236 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:07:58.738711 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cd3a0305-bff4-4c36-b3cb-72437c5bc236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:07:58.748269 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1296/2587] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:07:58.773934 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:07:58.785774 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e8bc6-e261-4d17-99c6-064c67f0eab3 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:07:58.792923 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:07:58.793484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:07:58.793792 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:07:58.794065 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:07:58.802929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:07:58.804508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:07:58.814209 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1292/2588] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:07:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:01.842644 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d816-e319-4f20-bd6e-7a79e15130bd None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.843190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d816-e319-4f20-bd6e-7a79e15130bd None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.843190 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53d816-e319-4f20-bd6e-7a79e15130bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.869006 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-6b53d816-e319-4f20-bd6e-7a79e15130bd None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:01.870245 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-6b53d816-e319-4f20-bd6e-7a79e15130bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:01.879810 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1297/2589] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:01.900735 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:01.914966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59e2c-bc5b-4e17-b1b7-e58183f4c213 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:01.923994 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:01.924584 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:01.924858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:01.925156 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:01.934045 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:01.935682 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:01.945953 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1293/2590] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:05.021583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf57-4845-480e-a296-1c6cb2adb509 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:05.022097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf57-4845-480e-a296-1c6cb2adb509 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:05.022097 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1bf57-4845-480e-a296-1c6cb2adb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:05.043387 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-71e1bf57-4845-480e-a296-1c6cb2adb509 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:05.044592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-71e1bf57-4845-480e-a296-1c6cb2adb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:05.054175 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1298/2591] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:05.076950 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:05.088825 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce14f0c-f3b5-4e58-b2e7-5ba8d0dd9c6f service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:05.096432 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:05.097168 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:05.097440 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:05.097703 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:05.106778 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:05.108484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:05.118444 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1294/2592] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:09.237706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:09.238237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:09.238237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:09.259361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:09.260560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:09.270321 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1299/2593] 10.222.0.43 () {58 vars in 1016 bytes} [Sun Oct 16 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:09.292976 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:09.304509 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cd303-ac32-45ac-a01a-12565de0f05b service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:09.311402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:09.311988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:09.312260 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:09.312525 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:09.321087 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:09.322673 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:09.332281 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1295/2594] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:19.253385 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=15 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:19.328140 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=30 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:38.741207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:38.742660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:38.754652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714d04-f1e5-4023-a325-6b559caf7101 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:38.759935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:38.760592 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:38.760881 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:38.761148 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] PATH_INFO: `/v3/users/91b45f14af1e45a491ceed5b26a353b3` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:38.762238 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b45f14af1e45a491ceed5b26a353b3)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:38.764146 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:38.812207 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b45f14af1e45a491ceed5b26a353b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:38.820608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b45f14af1e45a491ceed5b26a353b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:38.832764 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b45f14af1e45a491ceed5b26a353b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:38.840149 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b45f14af1e45a491ceed5b26a353b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:38.840860 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-b7bedbcc-0c7b-48f5-88e4-40955054116f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b45f14af1e45a491ceed5b26a353b3'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:38.847386 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1300/2595] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:08:38 2022] DELETE /identity/v3/users/91b45f14af1e45a491ceed5b26a353b3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:39.046544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.056602 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1ac14-944b-4b9b-a813-28b3181bcfa3 service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.120145 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.120775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.121092 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.121354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] PATH_INFO: `/v3/projects/6eb6fce9d1af4831b9766b5221e83a39` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.122508 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb6fce9d1af4831b9766b5221e83a39)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.124451 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.172559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb6fce9d1af4831b9766b5221e83a39', 'request_id': 'req-0736159d-b387-42ef-8af5-b0542438f2ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:39.177947 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb6fce9d1af4831b9766b5221e83a39', 'request_id': 'req-0736159d-b387-42ef-8af5-b0542438f2ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:39.184464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb6fce9d1af4831b9766b5221e83a39', 'request_id': 'req-0736159d-b387-42ef-8af5-b0542438f2ee'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:39.197587 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] The token cache is being invalidate because project 6eb6fce9d1af4831b9766b5221e83a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:08:39.197866 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:39.198465 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-0736159d-b387-42ef-8af5-b0542438f2ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:08:39.199934 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1296/2596] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:08:39 2022] DELETE /identity/v3/projects/6eb6fce9d1af4831b9766b5221e83a39 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:39.205012 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.205291 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.205556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.226563 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:39.227820 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:39.290949 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1301/2597] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:39.299348 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973de8-9094-490e-9973-36275dc59d06 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.299633 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973de8-9094-490e-9973-36275dc59d06 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.299902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973de8-9094-490e-9973-36275dc59d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.320510 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-43973de8-9094-490e-9973-36275dc59d06 None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:39.321731 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-43973de8-9094-490e-9973-36275dc59d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:39.330896 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1297/2598] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:39.335201 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.345368 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f2d4-9ce9-4405-8f3c-c4ef34f0c165 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.351045 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.351636 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.351908 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.352170 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] PATH_INFO: `/v3/domains` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.352802 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 16 01:08:39.353119 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.354710 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.366848 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1302/2599] 10.222.0.13 () {58 vars in 1153 bytes} [Sun Oct 16 01:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 16 01:08:39.371122 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973de8-9094-490e-9973-36275dc59d06 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.380816 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973de8-9094-490e-9973-36275dc59d06 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.386413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.387027 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.387298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.387554 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.388169 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.390105 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.419706 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1298/2600] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:39.424186 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.434345 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2e681-7c19-48e8-b334-ef44a9c3806a admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.490556 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.491172 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.491447 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.491699 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.492326 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.494284 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.502208 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:39.518622 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1303/2601] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:39.522757 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.533255 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43f77c-f04f-44b5-af4d-db8658a318a3 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.538048 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.538643 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.538918 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.539188 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.539847 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.541490 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.551434 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1299/2602] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:39.562645 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.574034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d0cb5-e7e8-49e5-a0b3-bea2ed6db084 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.579587 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.580184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.580456 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.580705 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] PATH_INFO: `/v3/roles` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.581365 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.582966 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53f2d-2b55-4cf3-87e1-c7b5f774221f admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.594119 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1304/2603] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:39.598763 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.610117 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd175502-dd7a-4a08-8e74-0660111abc84 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.616021 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.616664 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] REQUEST_METHOD: `PUT` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.616970 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.617245 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] PATH_INFO: `/v3/projects/0ab987ef18b2446bad98b1cee2631483/users/8e4b9d82feb54094ac30f3acb29c005a/roles/7b0ec29716c44100940a0056ee094bab` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.633033 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab987ef18b2446bad98b1cee2631483, user_id=8e4b9d82feb54094ac30f3acb29c005a, role_id=7b0ec29716c44100940a0056ee094bab)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.635700 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.650535 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1300/2604] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:39 2022] PUT /identity/v3/projects/0ab987ef18b2446bad98b1cee2631483/users/8e4b9d82feb54094ac30f3acb29c005a/roles/7b0ec29716c44100940a0056ee094bab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:39.655460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce2e6-4753-4cf8-b327-6f9f7d2da0be None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.655738 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce2e6-4753-4cf8-b327-6f9f7d2da0be None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.656099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ce2e6-4753-4cf8-b327-6f9f7d2da0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.676042 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-128ce2e6-4753-4cf8-b327-6f9f7d2da0be None None] MFA Rules not processed for user `1cfb0a7e76e5448c9456b4ef4f0b5fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:39.677239 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-128ce2e6-4753-4cf8-b327-6f9f7d2da0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:39.743862 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1305/2605] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:39.754559 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:39.756595 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:39.789545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:39.818028 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349dc40f-9e11-482a-9e3a-b81441cc358c admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:39.822124 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:39.822723 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:39.822992 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:39.823258 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:39.832647 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:39.834123 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:39.843574 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1301/2606] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:43.700945 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:43.701460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:43.701460 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.731714 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.auth.core [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] MFA Rules not processed for user `8e4b9d82feb54094ac30f3acb29c005a`. Rule list: `[]` (Enabled: `True`). {{(pid=81465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:43.733608 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:43.804551 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1306/2607] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:43.809030 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:43.819207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77dcbe-c99d-4b8f-960d-02f993c7c856 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:43.823873 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:43.824470 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:43.824736 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:43.825038 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.825670 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:43.827580 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:43.856628 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1302/2608] 10.222.0.13 () {60 vars in 1153 bytes} [Sun Oct 16 01:08:43 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 16 01:08:43.861028 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:43.873386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c6473-645c-4ddc-a2c8-0bb9957d32c6 None None] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:43.934330 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:43.934923 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:43.935191 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:43.935457 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.936064 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:43.938061 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:43.955919 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:08:43.963234 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1307/2609] 10.222.0.13 () {60 vars in 1144 bytes} [Sun Oct 16 01:08:43 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 16 01:08:43.966811 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:43.978093 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330a4b-bf28-42b9-af98-c1a293463b70 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:43.983225 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:43.983988 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:43.984415 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:43.984775 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:43.985671 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:43.987619 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:43.999692 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1303/2610] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:44.003980 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:44.014362 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1eb477-6a6d-4a3e-8826-1cde54e26bd3 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:44.019203 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:44.019800 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:44.020077 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:44.020342 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] PATH_INFO: `/v3/projects/bf853dbcc001465ea5d4af410805b91b/users/2b14dee61b354575998c41158aaaeaa0/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:44.036348 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf853dbcc001465ea5d4af410805b91b, user_id=2b14dee61b354575998c41158aaaeaa0, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:44.039011 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:44.053035 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1308/2611] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:44 2022] PUT /identity/v3/projects/bf853dbcc001465ea5d4af410805b91b/users/2b14dee61b354575998c41158aaaeaa0/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:44.057420 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:44.067771 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425b08-ae41-4beb-950c-06c8ea895609 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:44.128097 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:44.128724 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:44.129010 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:44.129274 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:44.129905 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:44.131517 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c3ace-842d-4be1-a48f-a0c3dbceca49 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:44.141645 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1304/2612] 10.222.0.13 () {58 vars in 1122 bytes} [Sun Oct 16 01:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 16 01:08:44.145808 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:44.156140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799925f5-485d-4066-90e6-1f4659dcd6f1 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:44.161002 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:44.161650 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] REQUEST_METHOD: `PUT` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:44.161921 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:44.162187 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] PATH_INFO: `/v3/projects/bf853dbcc001465ea5d4af410805b91b/users/2b14dee61b354575998c41158aaaeaa0/roles/38fd9e343b93477a8dbf3d1c2a3799c4` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:44.164209 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf853dbcc001465ea5d4af410805b91b, user_id=2b14dee61b354575998c41158aaaeaa0, role_id=38fd9e343b93477a8dbf3d1c2a3799c4)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:44.166874 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:44.176821 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1309/2613] 10.222.0.13 () {60 vars in 1483 bytes} [Sun Oct 16 01:08:44 2022] PUT /identity/v3/projects/bf853dbcc001465ea5d4af410805b91b/users/2b14dee61b354575998c41158aaaeaa0/roles/38fd9e343b93477a8dbf3d1c2a3799c4 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:08:48.352989 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed0d5-181b-4ba8-a44c-192e95352b61 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:48.353466 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed0d5-181b-4ba8-a44c-192e95352b61 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:48.353578 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed0d5-181b-4ba8-a44c-192e95352b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:48.399784 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-160ed0d5-181b-4ba8-a44c-192e95352b61 None None] MFA Rules not processed for user `2b14dee61b354575998c41158aaaeaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:48.401047 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-160ed0d5-181b-4ba8-a44c-192e95352b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:48.529379 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1305/2614] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:48.550887 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:08:48.557913 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:48.664732 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127fa8f-b201-406a-ba6f-ad031ca55690 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:08:48.672026 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:08:48.672655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:48.672957 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:48.673226 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:48.771087 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:08:48.773660 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:08:48.787807 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1310/2615] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:08:50.083446 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:08:50.083982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:08:50.083982 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:08:50.106129 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] MFA Rules not processed for user `8e4b9d82feb54094ac30f3acb29c005a`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:08:50.107959 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:08:50.114905 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1306/2616] 10.222.0.13 () {58 vars in 958 bytes} [Sun Oct 16 01:08:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:08:58.781019 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:00.100972 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:07.891215 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:07.952599 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc7e97-456d-4765-9446-5c2c87392f1a service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:07.956628 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:07.957255 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:07.957521 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:07.957784 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:07.959655 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:07.969317 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:07.970766 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:07.979179 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1311/2617] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:17.975475 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=26 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:20.687090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:20.698719 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cb35a-f938-4ad5-a875-8e0f8c782958 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:20.704049 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:20.704652 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:20.704958 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:20.705223 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:20.714897 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:20.716345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748452c-178a-442f-9f1c-64e8d02f67de service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:20.726092 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1307/2618] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:30.722037 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:47.841205 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:47.842652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:47.915390 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0224318-b5e8-40f1-bd60-c76d339818ac service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:47.920445 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:47.921081 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:47.921359 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:47.921625 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:47.923485 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:47.935928 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:47.937627 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:47.949083 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1312/2619] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:48.790821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] REQUEST_METHOD: `POST` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:48.791310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:48.791310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:48.818382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.auth.core [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] MFA Rules not processed for user `270eef82009744d8b43e43c86514e519`. Rule list: `[]` (Enabled: `True`). {{(pid=81466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 16 01:09:48.819581 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:48.879941 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1308/2620] 10.222.0.13 () {58 vars in 967 bytes} [Sun Oct 16 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 16 01:09:48.922358 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:48.923816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:48.996308 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f703-64db-4c5e-84ff-2154737caf4c service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:49.001782 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fdb324c26934b11b3c4fe8dff574d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:49.002386 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:49.002664 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:49.002935 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:49.011194 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:49.012816 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:49.021322 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1313/2621] 10.222.0.13 () {60 vars in 1384 bytes} [Sun Oct 16 01:09:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 16 01:09:52.230599 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:52.244917 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfb406-c60a-4035-a532-bdb6c5b68280 None None] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:52.250886 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:52.251622 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:52.251983 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:52.252321 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:52.254332 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:52.266761 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:52.268823 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:52.282670 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1309/2622] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:09:55.689364 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:55.692217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:55.758275 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee8bd4-9fb0-49d9-97d7-f5236269108a service swift] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:55.763549 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:55.764174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:55.764444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:55.764709 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] PATH_INFO: `/v3/users/0ba011221c4d4f5aa17d63bec4762c42` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:55.765898 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba011221c4d4f5aa17d63bec4762c42)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:55.767956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:55.802867 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:55.832444 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba011221c4d4f5aa17d63bec4762c42'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:55.840633 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba011221c4d4f5aa17d63bec4762c42'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:55.852978 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba011221c4d4f5aa17d63bec4762c42'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:55.860321 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba011221c4d4f5aa17d63bec4762c42'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:55.861111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba011221c4d4f5aa17d63bec4762c42'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:55.867469 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1314/2623] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:09:55 2022] DELETE /identity/v3/users/0ba011221c4d4f5aa17d63bec4762c42 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:56.056272 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:56.067484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd766a-116b-4ed2-9310-cb45b9267260 service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:56.127962 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:56.128585 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:56.128858 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:56.129175 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] PATH_INFO: `/v3/projects/7f2d2934c1834e02a6568c67cea56be5` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:56.130307 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2d2934c1834e02a6568c67cea56be5)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:56.132219 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:56.179966 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2d2934c1834e02a6568c67cea56be5', 'request_id': 'req-ef8ad05a-28be-4819-963d-32d4c816062f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.186342 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2d2934c1834e02a6568c67cea56be5', 'request_id': 'req-ef8ad05a-28be-4819-963d-32d4c816062f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.192828 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2d2934c1834e02a6568c67cea56be5', 'request_id': 'req-ef8ad05a-28be-4819-963d-32d4c816062f'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.207632 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] The token cache is being invalidate because project 7f2d2934c1834e02a6568c67cea56be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:09:56.207891 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.208544 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.210070 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1310/2624] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:56 2022] DELETE /identity/v3/projects/7f2d2934c1834e02a6568c67cea56be5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:56.214180 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:56.215629 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:56.229338 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f1f7-664b-4561-950f-28f1897835d8 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:56.289217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:56.289838 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:56.290105 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:56.290370 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] PATH_INFO: `/v3/users/15fa0536145847beaa34543028d27183` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:56.291492 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fa0536145847beaa34543028d27183)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:56.293461 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:56.343441 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fa0536145847beaa34543028d27183'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.351671 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fa0536145847beaa34543028d27183'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.363300 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fa0536145847beaa34543028d27183'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.370038 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fa0536145847beaa34543028d27183'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.370663 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fa0536145847beaa34543028d27183'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.376690 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1315/2625] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:09:56 2022] DELETE /identity/v3/users/15fa0536145847beaa34543028d27183 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:09:56.556803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:09:56.558354 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:09:56.571413 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad05a-28be-4819-963d-32d4c816062f admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:09:56.590480 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:09:56.630929 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:09:56.631473 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:09:56.631743 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:09:56.632025 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] PATH_INFO: `/v3/projects/559c79592c32439ca441888ff50173a8` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:09:56.633164 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559c79592c32439ca441888ff50173a8)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:09:56.635090 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:09:56.680404 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559c79592c32439ca441888ff50173a8', 'request_id': 'req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.685829 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559c79592c32439ca441888ff50173a8', 'request_id': 'req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.691804 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559c79592c32439ca441888ff50173a8', 'request_id': 'req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.705609 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] The token cache is being invalidate because project 559c79592c32439ca441888ff50173a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:09:56.705885 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.706491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:09:56.708046 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1311/2626] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:09:56 2022] DELETE /identity/v3/projects/559c79592c32439ca441888ff50173a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:10:06.373698 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:DELETE=17,keystone:SELECT=73,keystone:INSERT=2 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:10:06.702791 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:40.706757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:40.708254 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:40.766022 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9af75-ae70-4eca-bd3e-eac38dc2fcf7 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:40.817005 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:40.817622 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:40.817894 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:40.818158 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:40.820248 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:40.894541 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:40.895977 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:40.914987 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1316/2627] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:42.110727 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:42.112310 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.126205 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3a989-06dd-4f49-b6c5-7d5d84ad6405 admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:42.130498 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:42.131106 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:42.131382 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:42.131651 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:42.133409 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:42.148626 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:42.150596 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:42.162397 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1312/2628] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:50.903250 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=74 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:52.157487 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:11:54.349249 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:54.358657 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b691a-444c-480a-b45e-554eb5ab2145 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:54.362687 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:54.363290 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:54.363560 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:54.363823 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:54.365611 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:54.375642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:54.377193 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:54.385726 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1317/2629] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:54.486902 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:54.496152 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336389a-09bc-463f-8b76-56fa07ab4861 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:54.500644 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:54.501506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:54.501506 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:54.501720 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:54.503565 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:54.518298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:54.519879 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:54.531217 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1313/2630] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:11:54.600829 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:11:54.602361 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:54.674652 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f35011-9949-40da-8fe9-120e39ab3480 service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:11:54.681051 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:11:54.681656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:11:54.681927 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:11:54.682184 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:11:54.684240 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:11:54.696095 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:11:54.697745 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:11:54.707821 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1318/2631] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:12:04.526001 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:04.703757 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=38 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:12:14.899425 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:12:14.901882 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:14.916298 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9cf867-675c-4e57-8ee8-d8723e4a1992 service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:12:14.921150 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:12:14.921746 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:12:14.922023 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:12:14.922285 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:12:14.924286 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:12:14.934575 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:12:14.936064 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:12:14.944606 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1314/2632] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:12:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 16 01:12:24.940803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=6 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:40.559099 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:40.561202 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:40.580692 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b83860-56dd-41a9-9b87-58f9363a9c9b service placement] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:40.586522 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:40.587196 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:40.587565 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:40.587924 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:40.589794 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:40.603125 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:40.605034 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:40.616289 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1319/2633] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:43.231464 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:43.233345 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:43.250768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0d257-8f89-46db-9dc6-a141fdb5427e service neutron] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:43.256230 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3741f090453c44c2b2d2d2b41af8330d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:43.257020 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:43.257294 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:43.257567 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:43.259491 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:43.272821 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:43.274453 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:43.286906 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1315/2634] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:44.472237 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:44.482295 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bf73f-4b92-403a-80c1-bd2d0c5810e6 service nova] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:44.486100 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c7b0785a6f43809e892a2aa4d7f8c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:44.486726 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:44.486998 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:44.487264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:44.493883 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:44.563594 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:44.565060 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:44.574873 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1320/2635] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:47.679653 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:47.682246 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:47.705572 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439220d0-41a3-4d32-9570-afe620309c7a service nova] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:47.710935 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:47.711545 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] REQUEST_METHOD: `GET` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:47.711819 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:47.712686 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:47.718127 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:47.733948 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:47.736103 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:47.747241 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1316/2636] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:13:51.032946 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:51.036217 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:51.049858 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f204b-3c17-4126-8273-7289cc75a58b service neutron] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:51.055877 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:51.056715 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:51.057204 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:51.057642 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] PATH_INFO: `/v3/users/8e4b9d82feb54094ac30f3acb29c005a` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:51.059016 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4b9d82feb54094ac30f3acb29c005a)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:51.064166 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:51.137776 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4b9d82feb54094ac30f3acb29c005a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.139606 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4b9d82feb54094ac30f3acb29c005a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.152223 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4b9d82feb54094ac30f3acb29c005a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.159311 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4b9d82feb54094ac30f3acb29c005a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.159956 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4b9d82feb54094ac30f3acb29c005a'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.165902 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1321/2637] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:51 2022] DELETE /identity/v3/users/8e4b9d82feb54094ac30f3acb29c005a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:51.339721 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:51.356768 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86010647-a260-45a0-bab8-7a4ebf29f40a service placement] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:51.412472 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:51.413125 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:51.413402 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:51.413667 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] PATH_INFO: `/v3/projects/0ab987ef18b2446bad98b1cee2631483` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:51.414803 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab987ef18b2446bad98b1cee2631483)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:51.416820 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:51.465942 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab987ef18b2446bad98b1cee2631483', 'request_id': 'req-b8cfb528-b47f-4b0a-988c-dec358b67b8e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.472008 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab987ef18b2446bad98b1cee2631483', 'request_id': 'req-b8cfb528-b47f-4b0a-988c-dec358b67b8e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.479207 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab987ef18b2446bad98b1cee2631483', 'request_id': 'req-b8cfb528-b47f-4b0a-988c-dec358b67b8e'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.493240 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] The token cache is being invalidate because project 0ab987ef18b2446bad98b1cee2631483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:51.493528 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.494206 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.495913 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1317/2638] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:51 2022] DELETE /identity/v3/projects/0ab987ef18b2446bad98b1cee2631483 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:51.500229 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:51.501685 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:51.514805 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab53d5-e9f8-4c42-adfd-7c6d6ffeb969 admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:51.564749 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:51.577104 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:51.577896 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:51.578553 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:51.579141 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] PATH_INFO: `/v3/users/2b14dee61b354575998c41158aaaeaa0` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:51.581501 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b14dee61b354575998c41158aaaeaa0)` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:51.584569 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:51.638583 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b14dee61b354575998c41158aaaeaa0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.647416 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b14dee61b354575998c41158aaaeaa0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.659989 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b14dee61b354575998c41158aaaeaa0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.667285 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b14dee61b354575998c41158aaaeaa0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.667913 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.notifications [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b14dee61b354575998c41158aaaeaa0'} {{(pid=81465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.674219 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1322/2639] 10.222.0.13 () {58 vars in 1224 bytes} [Sun Oct 16 01:13:51 2022] DELETE /identity/v3/users/2b14dee61b354575998c41158aaaeaa0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:13:51.851388 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Authenticating user token {{(pid=81466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:13:51.853435 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.fernet_utils [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:13:51.867100 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cfb528-b47f-4b0a-988c-dec358b67b8e admin admin] Validating token access rules against request {{(pid=81466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:13:51.924147 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cfb0a7e76e5448c9456b4ef4f0b5fd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76fd6f2e827447f4be188ab2a5fb6b88', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:13:51.924689 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:13:51.924995 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:13:51.925248 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] PATH_INFO: `/v3/projects/bf853dbcc001465ea5d4af410805b91b` {{(pid=81466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:13:51.926478 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf853dbcc001465ea5d4af410805b91b)` {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:13:51.928352 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] RBAC: Authorization granted {{(pid=81466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:13:51.934977 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:13:51.987497 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf853dbcc001465ea5d4af410805b91b', 'request_id': 'req-6532d514-048c-44d1-8079-9e6ac039a639'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.993340 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf853dbcc001465ea5d4af410805b91b', 'request_id': 'req-6532d514-048c-44d1-8079-9e6ac039a639'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:51.999484 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf853dbcc001465ea5d4af410805b91b', 'request_id': 'req-6532d514-048c-44d1-8079-9e6ac039a639'} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:52.014158 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] The token cache is being invalidate because project bf853dbcc001465ea5d4af410805b91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 16 01:13:52.014441 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:52.015042 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG keystone.notifications [None req-6532d514-048c-44d1-8079-9e6ac039a639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 16 01:13:52.016538 dv-cinder-master-3-smb devstack@keystone.service[81466]: [pid: 81466|app: 0|req: 1318/2640] 10.222.0.13 () {58 vars in 1233 bytes} [Sun Oct 16 01:13:51 2022] DELETE /identity/v3/projects/bf853dbcc001465ea5d4af410805b91b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 16 01:14:01.670716 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:14:02.011468 dv-cinder-master-3-smb devstack@keystone.service[81466]: DEBUG dbcounter [-] [81466] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 16 01:15:10.168140 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Authenticating user token {{(pid=81465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 16 01:15:10.169706 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:10.315635 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3189f1-fa54-414b-a956-00c57d2d3b0e admin admin] Validating token access rules against request {{(pid=81465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 16 01:15:10.378111 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410ef41768a448bda827bac4b6ba411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b5a862a0a8b49eca441fb45f9733419', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 16 01:15:10.378638 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] REQUEST_METHOD: `GET` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 16 01:15:10.378911 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] SCRIPT_NAME: `/identity` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 16 01:15:10.379174 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 16 01:15:10.381264 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.fernet_utils [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 16 01:15:10.392656 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 16 01:15:10.394269 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c40de2-c312-4bc8-a614-eba2bb73912c service placement] RBAC: Authorization granted {{(pid=81465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 16 01:15:10.404240 dv-cinder-master-3-smb devstack@keystone.service[81465]: [pid: 81465|app: 0|req: 1323/2641] 10.222.0.13 () {60 vars in 1365 bytes} [Sun Oct 16 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 16 01:15:20.400438 dv-cinder-master-3-smb devstack@keystone.service[81465]: DEBUG dbcounter [-] [81465] Writing DB stats keystone:SELECT=89 {{(pid=81465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}